Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
scrape_from [2021/09/29 07:36] – added note about ARRM atariscrape_from [2025/08/19 21:15] (current) – Added IGDB configuration lbrpdx
Line 1: Line 1:
 ====== Scrape From ====== ====== Scrape From ======
  
-This option is to allow you to change the source of where your images are coming from. It allows you to choose from [[http://adb.arcadeitalia.net/|Arcade Database]], [[https://thegamesdb.net/|theGameDB]] or [[https://www.screenscraper.fr|Screenscraper]].+This option is to allow you to change the source of where your images are coming from. It allows you to choose from [[http://adb.arcadeitalia.net/|Arcade Database]], [[https://thegamesdb.net/|theGameDB]][[https://www.screenscraper.fr|Screenscraper]] and [[https://www.igdb.com/|IGDB]].
  
 Screenscraper offers more options for game scraping (for example several image options, you can scrape video previews, etc.). But there is also a **limitation in the number of assets you can download each day**: 50,000 requests max per day. Also, if you use a "mix" for the image, be aware that you need to download a screenshot + box + game title/marquee, which are 3 downloads for 1 composite image.  Screenscraper offers more options for game scraping (for example several image options, you can scrape video previews, etc.). But there is also a **limitation in the number of assets you can download each day**: 50,000 requests max per day. Also, if you use a "mix" for the image, be aware that you need to download a screenshot + box + game title/marquee, which are 3 downloads for 1 composite image. 
  
-In order to use ScreenScraper, you need to create a login on their website (otherwise you'll get a message in French telling that you need to register an account there).+In order to use ScreenScraper, you need to create a login on [[https://screenscraper.fr/|their website]] (otherwise you'll get a message in French telling that you need to register an account there).
  
-===== Settings =====+Configuration is through **Main Menu** > **Scrape**. More info at [[:menu_tree#scrape]].
  
-Configuration is through **Main Menu** > **Scrape**: +IGDB has been introduced with Batocera 42, and it requires to enter IGDB ''Client ID'' and ''Client secret'' on scraper menuYou need to follow [[https://api-docs.igdb.com/#getting-started|their API guide]] to get your ownAs of now, you need Twitch account to access IGDB APIThe ''Client ID'' and ''Client secret'' are pretty long stringsso you might want to copy/paste them into filesee how to proceed below.
-  * **Scrape From** Choose your database source. Remaining options will appear/disappear based on thisRead [[scrape_from|Scrape From]] for more info. +
-  * **Image Source** +
-  * **Box Source** Prefer 2D boxart or an automatically generated 3D render of the boxart. This will apply to both the boxart thumbnail image and the "Mix" image outputs. +
-  * **Logo Source** Choose whether to use the marquee (with its own background) or the wheel (with a transparent background) for the logo. +
-  * **Scrape Ratings** {{:switch-button.png?20|}} This option will scrape the user ratings of each game and will be displayed with the artwork you downloadedThis can be helpful when wanting to try new games you have never played before. +
-  * **Scrape Videos** {{:switch-button.png?20|}} Downloads a short, low-resolution video to play when the game is selectedThis option takes up a lot of bandwidth and will dramatically increase your scraping time for large collections! Weaker SBCs may also struggle with this. +
-  * **Scrape Fanart** {{:switch-button.png?20|}} Downloads HD fanart of the game to display in the background/screensaverDepends on how the theme has implemented it. +
-  * **Scrape Manual** {{:switch-button.png?20|}} Batocera 5.27+ offers you the ability to show game manuals (by hitting ''[Select]'' on a game) if you scraped the manuals. +
-  * **Scrape Pad2key settings** {{:switch-button.png?20|}} For Batocera v29+, you can automatically download a [[emulators:pad2key|pad2key profile to use the joypad to emulate keyboard]]. +
-  * **Username** if you use [[scrape_from|screenscraper as a source]]and you have an account with multiple threads, using your screenscraper username and password here will leverage scraping with as many parallel threads as you have access to. It's **a lot** faster. +
-  * **Password** +
-  * **Scrape Now** Begin scraping. Your system may become unresponsive for a moment, but scraping will begin in the background. When done, be sure to **Update Games Lists** to see your boxart!+
  
 ===== F.A.Q. ===== ===== F.A.Q. =====
Line 29: Line 17:
 No, scraping is part of the EmulationStation binary, and can be only started from there. However, you can use [[https://forum.batocera.org/d/1288-arrm-scraper-gamelist-roms-manager|the ARRM tool]] to easily manage your ''gamelist.xml'' files from Windows. No, scraping is part of the EmulationStation binary, and can be only started from there. However, you can use [[https://forum.batocera.org/d/1288-arrm-scraper-gamelist-roms-manager|the ARRM tool]] to easily manage your ''gamelist.xml'' files from Windows.
  
-==== I have a very complicated ScreenScraper password, where can I copy/paste it rather than using the EmulationStation keyboard? ====+==== I have a very complicated login or password, where can I copy/paste it rather than using the EmulationStation keyboard? ====
  
 You can edit ''/userdata/system/configs/emulationstation/es_settings.cfg'' and edit the section: You can edit ''/userdata/system/configs/emulationstation/es_settings.cfg'' and edit the section:
  
 +For Screenscraper:
 <code> <code>
     <string name="ScreenScraperUser" value="your_login" />     <string name="ScreenScraperUser" value="your_login" />
Line 38: Line 27:
 </code> </code>
  
-Make sure EmulationStation is stopped before editing this file, otherwiseES might reverse your modifications. If you're not sure how to stop EmulationStation before editing this, you probably should use the UI to enter your credentials ;-)+For IGDB: 
 +<code> 
 +    <string name="IGDBClientID" value="your_id" /> 
 +    <string name="IGDBSecret" value="your_secret" /> 
 +</code> 
 + 
 +Make sure EmulationStation is stopped before editing this file, otherwise **ES will reverse your modifications**. If you're not sure how to stop EmulationStation before editing this, you probably should use the UI to enter your credentials ;-)
  
 ==== I've entered my username and password correctly, and triple checked, yet I still can't login! ==== ==== I've entered my username and password correctly, and triple checked, yet I still can't login! ====
  • scrape_from.1632900974.txt.gz
  • Last modified: 5 years ago
  • by atari