What is the logical opposite of the word many?
Many of us are hungry.
not many/no more than a few
No more than a few of us are hungry.