There is not a lot you can do. While we have come a long way so far, we need to reduce the memory further on the development side. There has been some talk regarding moving some of the block data to a database which would trade RAM for disk and possibly lower performance.
RE: Crypto wallets memory usage by default