James Madison is often quoted as having been against hand-outs,
“I cannot undertake to lay my finger on that article of the Constitution which granted a right to Congress of expending, on objects of benevolence, the money of their constituents.”*
Although these probably weren’t James Madison’s exact words, Congressman Madison probably said something similar.