Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
scrape_from [2021/08/24 09:40] – consistency, added extra question about escaping characters (need confirmation) atariscrape_from [2023/12/20 18:48] (current) – Add screenscraper website link maximumentropy
Line 1: Line 1:
-~~NOTOC~~ 
 ====== Scrape From ====== ====== Scrape From ======
  
Line 6: Line 5:
 Screenscraper offers more options for game scraping (for example several image options, you can scrape video previews, etc.). But there is also a **limitation in the number of assets you can download each day**: 50,000 requests max per day. Also, if you use a "mix" for the image, be aware that you need to download a screenshot + box + game title/marquee, which are 3 downloads for 1 composite image.  Screenscraper offers more options for game scraping (for example several image options, you can scrape video previews, etc.). But there is also a **limitation in the number of assets you can download each day**: 50,000 requests max per day. Also, if you use a "mix" for the image, be aware that you need to download a screenshot + box + game title/marquee, which are 3 downloads for 1 composite image. 
  
-In order to use ScreenScraper, you need to create a login on their website (otherwise you'll get a message in French telling that you need to register an account there).+In order to use ScreenScraper, you need to create a login on [[https://screenscraper.fr/|their website]] (otherwise you'll get a message in French telling that you need to register an account there).
  
-===== Settings ===== +Configuration is through **Main Menu** > **Scrape**. More info at [[:menu_tree#scrape]].
- +
-Configuration is through **Main Menu** > **Scrape**: +
-  * **Scrape From** Choose your database source. Remaining options will appear/disappear based on this. Read [[scrape_from|Scrape From]] for more info. +
-  * **Image Source** +
-  * **Box Source** Prefer 2D boxart or an automatically generated 3D render of the boxart. This will apply to both the boxart thumbnail image and the "Mix" image outputs. +
-  * **Logo Source** Choose whether to use the marquee (with its own background) or the wheel (with a transparent background) for the logo. +
-  * **Scrape Ratings** {{:switch-button.png?20|}} This option will scrape the user ratings of each game and will be displayed with the artwork you downloaded. This can be helpful when wanting to try new games you have never played before. +
-  * **Scrape Videos** {{:switch-button.png?20|}} Downloads a short, low-resolution video to play when the game is selected. This option takes up a lot of bandwidth and will dramatically increase your scraping time for large collections! Weaker SBCs may also struggle with this. +
-  * **Scrape Fanart** {{:switch-button.png?20|}} Downloads a HD fanart of the game to display in the background/screensaver. Depends on how the theme has implemented it. +
-  * **Scrape Manual** {{:switch-button.png?20|}} Batocera 5.27+ offers you the ability to show game manuals (by hitting ''[Select]'' on a game) if you scraped the manuals. +
-  * **Scrape Pad2key settings** {{:switch-button.png?20|}} For Batocera v29+, you can automatically download a [[emulators:pad2key|pad2key profile to use the joypad to emulate a keyboard]]. +
-  * **Username** if you use [[scrape_from|screenscraper as a source]], and you have an account with multiple threads, using your screenscraper username and password here will leverage scraping with as many parallel threads as you have access to. It's **a lot** faster. +
-  * **Password** +
-  * **Scrape Now** Begin scraping. Your system may become unresponsive for a moment, but scraping will begin in the background. When done, be sure to **Update Games Lists** to see your boxart!+
  
 ===== F.A.Q. ===== ===== F.A.Q. =====
  
 ==== Is there any way you can launch scraping from the command line, like other retrogaming distributions? ==== ==== Is there any way you can launch scraping from the command line, like other retrogaming distributions? ====
-No, scraping is part of the EmulationStation binary, and can be only started from there.+ 
 +No, scraping is part of the EmulationStation binary, and can be only started from there. However, you can use [[https://forum.batocera.org/d/1288-arrm-scraper-gamelist-roms-manager|the ARRM tool]] to easily manage your ''gamelist.xml'' files from Windows.
  
 ==== I have a very complicated ScreenScraper password, where can I copy/paste it rather than using the EmulationStation keyboard? ==== ==== I have a very complicated ScreenScraper password, where can I copy/paste it rather than using the EmulationStation keyboard? ====
 +
 You can edit ''/userdata/system/configs/emulationstation/es_settings.cfg'' and edit the section: You can edit ''/userdata/system/configs/emulationstation/es_settings.cfg'' and edit the section:
  
Line 41: Line 28:
 ==== I've entered my username and password correctly, and triple checked, yet I still can't login! ==== ==== I've entered my username and password correctly, and triple checked, yet I still can't login! ====
  
-If your username/password contains any special characters (like ''?'', ''Ó'', ''±'', or ''№'') it won't be parsed correctly by ES and you'll fail to login. Should have chosen a simpler password.+If your username/password contains any special characters (like ''?'', ''Ó'', ''±'', or ''№'') it won't be parsed correctly by ES and you'll fail to login. Should have chosen a simpler password! :-P
  
 Just kidding. You must escape special characters with a preceding backslash (''\''), eg. ''%%specialcharacter?inmypassword%%'' would become ''%%specialcharacter\?inmypassword%%''. If the ''\'' itself is in your password, just use ''%%\\%%''. Just kidding. You must escape special characters with a preceding backslash (''\''), eg. ''%%specialcharacter?inmypassword%%'' would become ''%%specialcharacter\?inmypassword%%''. If the ''\'' itself is in your password, just use ''%%\\%%''.
 +
  • scrape_from.1629790809.txt.gz
  • Last modified: 3 years ago
  • by atari