Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
scrape_from [2021/05/25 22:01] – Precisions about scraping lbrpdxscrape_from [2025/08/19 21:15] (current) – Added IGDB configuration lbrpdx
Line 1: Line 1:
-~~NOTOC~~ +====== Scrape From ======
-===== Scrape From =====+
  
-This option is to allow you to change the source of where your images are coming from. It allows you to choose from [[http://adb.arcadeitalia.net/|Arcade Database]], [[https://thegamesdb.net/|theGameDB]] or [[https://www.screenscraper.fr|Screenscraper]].+This option is to allow you to change the source of where your images are coming from. It allows you to choose from [[http://adb.arcadeitalia.net/|Arcade Database]], [[https://thegamesdb.net/|theGameDB]][[https://www.screenscraper.fr|Screenscraper]] and [[https://www.igdb.com/|IGDB]].
  
 Screenscraper offers more options for game scraping (for example several image options, you can scrape video previews, etc.). But there is also a **limitation in the number of assets you can download each day**: 50,000 requests max per day. Also, if you use a "mix" for the image, be aware that you need to download a screenshot + box + game title/marquee, which are 3 downloads for 1 composite image.  Screenscraper offers more options for game scraping (for example several image options, you can scrape video previews, etc.). But there is also a **limitation in the number of assets you can download each day**: 50,000 requests max per day. Also, if you use a "mix" for the image, be aware that you need to download a screenshot + box + game title/marquee, which are 3 downloads for 1 composite image. 
  
-In order to use Screenscraper, you need to create a login on their website (otherwise you'll get a message in French telling that you need to register an account there). +In order to use ScreenScraper, you need to create a login on [[https://screenscraper.fr/|their website]] (otherwise you'll get a message in French telling that you need to register an account there).
  
-====FAQ==== +Configuration is through **Main Menu** > **Scrape**. More info at [[:menu_tree#scrape]].
-//Is there any way you can launch scraping from the command line, like other retrogaming distributions?// No, scraping is part of the EmulationStation binary, and can be only started from there.+
  
-//I have a very complicated ScreenScraper passwordwhere can I copy/paste it rather than using the EmulationStation keyboard?// You can edit ''/userdata/system/configs/emulationstation/es_settings.cfg'' and edit the section:+IGDB has been introduced with Batocera 42and it requires to enter IGDB ''Client ID'' and ''Client secret'' on scraper menu. You need to follow [[https://api-docs.igdb.com/#getting-started|their API guide]] to get your ownAs of now, you need a Twitch account to access IGDB API. The ''Client ID'' and ''Client secret'' are pretty long strings, so you might want to copy/paste them into a file, see how to proceed below.
  
-        <string name="ScreenScraperUser" value="your_login" /> +===== F.A.Q. =====
-        <string name="ScreenScraperPass" value="your_pass" /> +
-        +
  
 +==== Is there any way you can launch scraping from the command line, like other retrogaming distributions? ====
  
 +No, scraping is part of the EmulationStation binary, and can be only started from there. However, you can use [[https://forum.batocera.org/d/1288-arrm-scraper-gamelist-roms-manager|the ARRM tool]] to easily manage your ''gamelist.xml'' files from Windows.
 +
 +==== I have a very complicated login or password, where can I copy/paste it rather than using the EmulationStation keyboard? ====
 +
 +You can edit ''/userdata/system/configs/emulationstation/es_settings.cfg'' and edit the section:
 +
 +For Screenscraper:
 +<code>
 +    <string name="ScreenScraperUser" value="your_login" />
 +    <string name="ScreenScraperPass" value="your_pass" />
 +</code>
 +
 +For IGDB:
 +<code>
 +    <string name="IGDBClientID" value="your_id" />
 +    <string name="IGDBSecret" value="your_secret" />
 +</code>
 +
 +Make sure EmulationStation is stopped before editing this file, otherwise **ES will reverse your modifications**. If you're not sure how to stop EmulationStation before editing this, you probably should use the UI to enter your credentials ;-)
 +
 +==== I've entered my username and password correctly, and triple checked, yet I still can't login! ====
 +
 +If your username/password contains any special characters (like ''?'', ''Ó'', ''±'', or ''№'') it won't be parsed correctly by ES and you'll fail to login. Should have chosen a simpler password! :-P
 +
 +Just kidding. You must escape special characters with a preceding backslash (''\''), eg. ''%%specialcharacter?inmypassword%%'' would become ''%%specialcharacter\?inmypassword%%''. If the ''\'' itself is in your password, just use ''%%\\%%''.
  
  • scrape_from.1621980119.txt.gz
  • Last modified: 5 years ago
  • by lbrpdx