Welcome to MTurk Crowd

Work on Amazon Mechanical Turk, learn from the best, and have fun doing it. Join the crowd today!

Sign Up

Android Scraper

Discussion in 'Userscripts, Extensions, and Software' started by saqfish, Mar 31, 2016.

  1. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Hey there turkers,

    I introduce Scraper for Android! It's a fully functional scraper that lets you scrape, preview, and accept hits straight from your Android phone/tablet! You can also:

    • View your Dashboard
    • View your queue
    • Filter hits by amount
    • Select how many hits to scrape
    • Use a block list
    • Use an include list
    • Get notifications for any includelisted or new hits
    • Panda manager
    • Sound on notifications
    Imagine that, now you'll never miss any breligs! You can also try a limited preview version here Oh any you can report any issues/requests here too.
     
    Collapse Signature Expand Signature
    #1 saqfish, Mar 31, 2016
    Last edited: Aug 27, 2016
    Starslip likes this.
  2. kryss

    kryss
    Expand Collapse
    carburante al fuoco

    • Administrator
    Joined:
    Jan 10, 2016
    Messages:
    20,500
    Likes:
    59,956
    Do you have to login to mturk to use it? Also, is this just a modified version of HS?
     
    Collapse Signature Expand Signature
    #2 kryss, Mar 31, 2016
    Last edited: Mar 31, 2016
  3. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Yes you have to login to use it so you can accept hits etc. Also it works heavily with requester ids. This app is totally java and has nothing to do with hitscraper. Thanks for asking!
     
    Collapse Signature Expand Signature
    Definitely Not Riss and kryss like this.
  4. kryss

    kryss
    Expand Collapse
    carburante al fuoco

    • Administrator
    Joined:
    Jan 10, 2016
    Messages:
    20,500
    Likes:
    59,956
    So you have access to that data?
     
    Collapse Signature Expand Signature
  5. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Nope. It is done through your Android browser. The app does not use this info. If the session expires you are required to login through the browser again. Similar to the javascript userscripts we all use on the computer. They don't handle login but rather use the browser to handle it.
     
    Collapse Signature Expand Signature
    #5 saqfish, Mar 31, 2016
    Last edited: Mar 31, 2016
    kryss likes this.
  6. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Version 1.2 is out! What's new:

    • Sound works with notifications
    • Settings for enabling notifications/sounds and picking a sound (Squee/Ding)
    • All settings and blocklist/includelist are saved

    What's planned in the next version:

    • Different views Latest/Most/etc
    • Indications for includelist/new hits
     
    Collapse Signature Expand Signature
  7. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Version 1.3 is out! What's new:

    • You can now view hits by Latest/Most (in settings)
    • You can chose to have sounds/notifications on either your include list or on new hits!
    • New hits have a "New!" text on the side and have different formatting!
    • Amount and hit number boxes stay open.
    Hope you guys enjoy the update. Feel free to ask questions!
     
    Collapse Signature Expand Signature
  8. Jerami

    Jerami
    Expand Collapse
    Ooh! oh-oh-oooh! A sparkly!

    • Contributor
    • HIT Poster
    • Mentor
    Joined:
    Jan 24, 2016
    Messages:
    10,985
    Likes:
    18,326
    Hey, so I was checking out your app. I like the fact that I can offload scraper duty to any old phone. The play store says that it isn't compatible with my device.(Kindle Fire) It could be just Google play being stupid. I'd love to get a bit of mileage out of this piece of shit tablet and dedicate it to the task of scraping, until it dies a horrible death. Before flashing my kernel to a generic Android increasing compatibility, do you think installing the apk without the Play Store may work? I'm willing to buy it via Google, or PayPal and I can use it on my phone if the tablet doesn't work out. Thanks @saqfish@saqfish
     
  9. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Hmm that's strange! Give me some time and ill check the minumum api I chose. Hopefully that works. If not, we'll try a few other things.
     
    Collapse Signature Expand Signature
  10. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    So I checked the minimum sdk set which was for 16 (KitKat). So it should work fine on yours. Also, so far 3 people have downloaded it for Android 4.1 (JellyBean) so it should technically work on yours since it is after. Maybe flashing might be a good idea?
     
    Collapse Signature Expand Signature
    Jerami likes this.
  11. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Version 1.4 is out! What's new:

    • Fixed issues with includelist adding.
    • Panda manager added (Not fully functional yet)

    What's planned for the next update;

    • Fully functioning panda manager!
     
    Collapse Signature Expand Signature
    Dharma likes this.
  12. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Version 1.5 is
    • Panda manager works great!
    • Import HitScraper include/block list. Now under manage!

    What's planned for the next update;
    • Notifications/Sounds for panda hit/captcha.
    Watch the demo here: https://youtu.be/KfQwKzoa5nQ
     
    Collapse Signature Expand Signature
    #12 saqfish, May 12, 2016
    Last edited: May 12, 2016
  13. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Sorry for the delay everyone! Version 1.6 is out! What's new:

    • Dashboard View
    • Queue View
    • Mismatch errors fixed!

    What's planned for the next update;

    • Fixes for panda manager.
     
    Collapse Signature Expand Signature
  14. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    There is now a free version with ads. Get it HERE!
     
    Collapse Signature Expand Signature
  15. ltheofan

    ltheofan
    Expand Collapse
    New Member

    Joined:
    Aug 2, 2016
    Messages:
    1
    Likes:
    0
    Hello, I'm using the free version of Scraper on my Android phone, v1.6.6. Is there a way to EXPORT pandas from this app so that if I catch a good panda while using scraper on my phone, I can send it to my laptop? I can't see any obvious way of exporting pandas. Thanks!!
     
  16. Snowlake

    Snowlake
    Expand Collapse
    New Member

    Joined:
    Jul 27, 2017
    Messages:
    1
    Likes:
    0
    I had troubles logging into scraper on my phone for the last few days. I get an email from Amazon with verification code, but there is nowhere to enter it. So I am not able to login.
     
  17. saqfish

    saqfish
    Expand Collapse
    Member

    Joined:
    Jan 20, 2016
    Messages:
    255
    Likes:
    183
    Try loging in on an actual computer. The app doesn't handle login stuff.
     
    Collapse Signature Expand Signature