The Calvert Fund (well known for socially responsible mutual fund management) has a community investment vehicle that will fit most any size investor from $20 and up. It is called "Community Investment Notes" and you can either specify a target region for your funds (such as New England) or allow the managers to apply your funds where they think they will do the most good.
You can use a self-directed IRA to make loans to this fund.
Start here to find out more.