Hello Masudul,
I have read the project requirements for Web Scraping with Beautifulsoup. Also, if you want to see my past work related to Web Crawler and Scaping, then I will show you. We have 11+ years of experience in software development. We have developed more than 400 projects and research papers in the fields of Data Analysis, NLP, machine learning, artificial intelligence, and SEO-based web and mobile apps.
We have successfully completed the projects of phishing detection, spam mail filter, HMM, encryption decryption,OCR, big data, data mining, data analysis, statistics, trading, text, natural language processing (NLP), image, multiclass classification using WEKA, Azure ML, Tensorflow, R programming, OpenCV, Matlab, Hadoop, artificial intelligence program using PROLOG, robotics software, TCP-UDP networking project, cloud computing, etc.
View my last projects based on web scraping, crawling, elastic search, data mining, machine learning, artificial intelligence, Python, and Java, and I can complete your project perfectly.
https://www.freelancer.com/u/vorasiddh4it/portfolio/keyword-search-engine-website-crawler-nlpnlg-locationwise-4832431
Note: The project has QA, testing, and comments in the code, so it's easy to upgrade in future.