Progress on HafSQL:
I have been developing views for all the operations including the virtual operations. That is done now and the result is 93 views for all the operations.
I did play with index creation for a while and after some testing on a fully synced haf node, ended up with 36 total indexes (partial indexes).
It takes around 3.5 hours for indexes to be created on i9-13900 with 12 parallel workers. This test is with ZFS+LZ4 on raid 0 NVMe setup.
Total storage usage is only by indexes and it is 185GB (non-compressed). 128GB of this space is used by indexes of custom
and custom_json
operations. This enables retrieving custom_json
operations by id
and by the username from required_auths
or required_posting_auths
parameters. I figured this can be a very useful feature for our apps when this gets implemented on the public RPC nodes.
The rest of the development will probably be making the live sync part of the application to track things like delegations.
The current code works as it is and is under the tag v0.0.1. Readme should be good enough to set everything up.
I did try my best to cover all the operations with indexes. Feedback is very welcome.
Code: https://gitlab.com/mahdiyari/hafsql
Proposal: DHF proposal - Hive related development
