A python library to push ethereum blockchain data into an sql database.
ether_sql
A Python library to push ethereum blockchain data into an sql database.ethersql was built by Analyse Ether, with the goal of making Ethereum data easily available to everyone. This library can be used as a backbone for creating block explorers or performing data analysis.
It is written in Python 3.5+, uses web3.py for geting data using JSON-RPC calls and uses SqlAlchemy to connect to a postgressql database.
Buidl Status
This is currently in very alpha stage, and not recommended for production use until it has received sufficient testing. Currently supports Geth, Infura and Parity node, but transaction traces (eg. internal transactions) are currently available only with Parity node.
Documentation available at: http://ether-sql.readthedocs.io
Installation guide
Please find the detailed installation guide here
Command line options
ether_sql has several built in cli commands to facilitate scraping data.Syncing the data
To start the sync just type.$ ethersql scrapeblock_range
This will start start pushing the data from an Infura node to the psql database.
Switching nodes
To switch nodes use the settings flag:
$ ethersql --settings='PersonalParitySettings' scrapeblock_range
Using multiple workers to sync data
To start 4 parallel workers use.$ ether_sql --settings=YourSettings celery start -c4
The above command will start 4 workers using the settings YourSettings Then start the sync, which will automatically use the setting used to start workers. $ ethersql scrapeblock_range
Here is a demo of the process: https://www.youtube.com/watch?v=rnkfyAgGJwI&feature=youtu.be
Exporting as csv
To export the pushed data as a csv
$ ethersql sql exportto_csv
To access other Command Line Interfaces (CLI) checkout the cli docs.
