A simple script that shows how to ingest a dataset from a file into Elasticsearch.
The file that is used for this example is a .csv so each row is turned into a document.
To run this example install the dependencies with pip:
python -m pip install -r requirements.txtand then run the script with Python:
python bulk-ingest.pyYou should see the script downloading the dataset into nyc-restaurants.csv
Once all the data is loaded into Elasticsearch you can do queries on the dataset or create visualizations within Kibana.
import elasticsearch
client = elasticsearch.Elasticsearch()
resp = client.search(
index="nyc-restaurants",
size=0,
body={
"aggs": {
"borough": {
"terms": {
"field": "borough"
},
"aggs": {
"grades": {
"terms": {
"field": "grade"
}
}
}
}
}
}
)
print(resp)