More homeowners say they are under water on their mortgage and more Americans are pessimistic about house prices, according to a quarterly consumer survey by Fannie Mae.

The number of mortgage borrowers who say they are under water increased to 26% in the second quarter survey, up from 23% in the prior quarter.

Of the underwater borrowers, 56% believe it would be difficult to refinance to take advantage of lower mortgage rates. At the same time, 46% of other mortgaged homeowners believe it would difficult to refinance.

The GSE's survey also showed 31% of minority borrowers are under water, compared to 23% other mortgage borrowers.

"On average, Americans expect home prices to go up 0.4% over the next year," Fannie Mae said, down from 0.9% in the first quarter.

Meanwhile, 2 out of 3 respondents support mortgage modification programs. "They think such programs help protect the economy and local communities from increased foreclosures and falling home prices," the agency said.

Subscribe Now

Access to a full range of industry content, analysis and expert commentary.

30-Day Free Trial

No credit card required. Access coverage of the securitization marketplace, including breaking news updated throughout the day.