Hi,
I have a wordpress auto bot that runs as plugin on my wordpress website and it scrapes adult videos from one website and it posts it up on my website. It currently scrapes videos from www.naughtyamerica.com. Please note my website is of adult nature so if that offends you please do not continue. The bot has been programmed in PHP and i have all the sourcecode for it. Recently however my bot had an issue where it was posting duplicate videos that it was scraping from the other website. I hired another coder who coded an image URL recognition script when if the bot finds a post with the same image URL as another post it has already posted in the past the bot ignores it completely. My bot currently runs automatically of my godaddy hosting on a cron script. It runs daily on a timestamp that i set manually from the times i want the bot to run to the time i want it to stop posting. The problem i am having now is when i set the bot to scrape 5 videos a day it only seems to be posting 2 videos instead of what i set it to be? I belive this could be connected to the duplicate post issue i had. When the scrapes videos from the other site it firstly stores them all in a database on my hosting and then everyday it picks how ever many videos i want posting and then it posts them on my blog. The reason for this is so that it does not need visit the initial site that it is getting the videos from everytime it needs to post videos on my blog. I will give choosen coder all the details they require.