Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
scrape_from [2020/01/28 19:29] – created genetik57scrape_from [2025/08/19 21:15] (current) – Added IGDB configuration lbrpdx
Line 1: Line 1:
-~~NOTOC~~ +====== Scrape From ======
-===== Scrape From =====+
  
-This option is to allow you to change the source of where your images are coming from. It allows you to choose from [[https://thegamesdb.net/|theGameDB]], or [[https://www.screenscraper.fr|Screenscraper]].+This option is to allow you to change the source of where your images are coming from. It allows you to choose from [[http://adb.arcadeitalia.net/|Arcade Database]], [[https://thegamesdb.net/|theGameDB]], [[https://www.screenscraper.fr|Screenscraper]] and [[https://www.igdb.com/|IGDB]]. 
 + 
 +Screenscraper offers more options for game scraping (for example several image options, you can scrape video previews, etc.). But there is also a **limitation in the number of assets you can download each day**: 50,000 requests max per day. Also, if you use a "mix" for the image, be aware that you need to download a screenshot + box + game title/marquee, which are 3 downloads for 1 composite image.  
 + 
 +In order to use ScreenScraper, you need to create a login on [[https://screenscraper.fr/|their website]] (otherwise you'll get a message in French telling that you need to register an account there). 
 + 
 +Configuration is through **Main Menu** > **Scrape**. More info at [[:menu_tree#scrape]]. 
 + 
 +IGDB has been introduced with Batocera 42, and it requires to enter IGDB ''Client ID'' and ''Client secret'' on scraper menu. You need to follow [[https://api-docs.igdb.com/#getting-started|their API guide]] to get your own. As of now, you need a Twitch account to access IGDB API. The ''Client ID'' and ''Client secret'' are pretty long strings, so you might want to copy/paste them into a file, see how to proceed below. 
 + 
 +===== F.A.Q. ===== 
 + 
 +==== Is there any way you can launch scraping from the command line, like other retrogaming distributions? ==== 
 + 
 +No, scraping is part of the EmulationStation binary, and can be only started from there. However, you can use [[https://forum.batocera.org/d/1288-arrm-scraper-gamelist-roms-manager|the ARRM tool]] to easily manage your ''gamelist.xml'' files from Windows. 
 + 
 +==== I have a very complicated login or password, where can I copy/paste it rather than using the EmulationStation keyboard? ==== 
 + 
 +You can edit ''/userdata/system/configs/emulationstation/es_settings.cfg'' and edit the section: 
 + 
 +For Screenscraper: 
 +<code> 
 +    <string name="ScreenScraperUser" value="your_login" /> 
 +    <string name="ScreenScraperPass" value="your_pass" /> 
 +</code> 
 + 
 +For IGDB: 
 +<code> 
 +    <string name="IGDBClientID" value="your_id" /> 
 +    <string name="IGDBSecret" value="your_secret" /> 
 +</code> 
 + 
 +Make sure EmulationStation is stopped before editing this file, otherwise **ES will reverse your modifications**. If you're not sure how to stop EmulationStation before editing this, you probably should use the UI to enter your credentials ;-) 
 + 
 +==== I've entered my username and password correctly, and triple checked, yet I still can't login! ==== 
 + 
 +If your username/password contains any special characters (like ''?'', ''Ó'', ''±'', or ''№'') it won't be parsed correctly by ES and you'll fail to login. Should have chosen a simpler password! :-P 
 + 
 +Just kidding. You must escape special characters with a preceding backslash (''\''), eg. ''%%specialcharacter?inmypassword%%'' would become ''%%specialcharacter\?inmypassword%%''. If the ''\'' itself is in your password, just use ''%%\\%%''.
  
-Screenscraper offers more options for game scraping (for example several image options, you can scrape video previews, etc.). But there is also a **limitation in the number of assets you can download each day**: 50,000 requests max per day. Also, if you use a "mix" for the image, be aware that you need to download a screenshot + box + game title/marquee, which are 3 downloads for 1 composite image. 
  • scrape_from.1580239760.txt.gz
  • Last modified: 6 years ago
  • by genetik57