What Are Scrapers?If it detects any new events, the details are then scraped and added to your Pending queue in Radmin for you to review and approve. Managing ScrapersThe Scrapers tab in Radmin is where you can view all the Scrapers running on your site, request new Scrapers to be built, and chat with the coders about fixes that are needed. From the main screen, you’re able to view all your metro’s Scrapers along with relevant details and recent activity for that Scraper. You will also see icons on the right for viewing the Scraper’s details (magnifying glass), editing the Scraper (pencil), and chatting with the coder about fixing or tweaking the Scraper (speech bubble). By clicking on the Scraper's name or magnifying glass, you can view the details page with all the information about that Scraper along with a summary of its most recent activity. You can also press "Run" to force the Scraper to run its script and look for any new Events. Fixing a Scraper If you find that a certain Scraper is repeatedly making mistakes, or isn’t running at all as it should, you should edit the Scraper to mark that a fix is needed and then send the coder details about the problem To mark that a fix is needed, open up the Scraper’s details page and click “Edit”, or just click the pencil icon to the right of the Scraper. Then, check the box that says “Needs Fix” and press “Save”. Our coders will automatically be notified that the Scraper needs a fix, but you need to provide details before they can know what the solution is. To do this, click the speech bubble icon on the main Scraper page or on that particular Scraper’s details page. In the chat window that pops up, describe the issue and any other details that the coder may need to know to diagnose the problem. Whenever the coder responds, you will receive an email notification to check the message inbox for that Scraper. You and the coder can continue to chat about the problem in Radmin until the Scraper is fixed. Adding a New ScraperThe Scrapers tab in Radmin is where you can view all the Scrapers running on your site, request new Scrapers to be built, and chat with the coders about fixes that are needed. After you clicking the “New Scraper” button on the main Scraper page, you’ll be presented with the form below. These are the details that our team of coders will use to build your new Scraper.
After filling out all the relevant details, click "Next". From here one of two things will happen. If you selected an existing script in #4 above, your Scraper will be created immediately. Congratulations, you're done. If you left #4 blank and checked "Script Needed" (#7), you will be presented with the screen below. Fill out as many of the boxes as you can for the top event on the URL you are linking to, along with any notes for the coder that will be writing the new script. This way he/she will know how to design the script to read the page accurately. Building a new script can take a few days or more, so it will take a bit longer to get your Scraper than if you use an existing script. Want more?Want to learn more about how Events are pulled into your site? Click here to read about approving Events in the Pending queue, handling Duplicate Events, and managing Approved Events. |