Python package kafka-python was used to establish connection with KAFKA and consume data from it.
Subsequently, data was pushed onto Elasticsearch DB using python package elasticsearch. This was ensured by installing elasticsearch on an ec2 instance using docker.
Kibana was installed on the AWS instance and reverse proxy was done to ensure it was accessible via HTTP.