I missed the first challenge. Here goes:
WFDownloader App: Cross-platform general purpose bulk downloader however, I use it mostly to bulk download tv series, cartoons, anime, manga, wallpapers, music, videos, etc from the many sites it supports.
DVDVideoSoft: Contains many free DVD/Video conversion tools and it supports many formats.
Virtual Box: Use this virtual machine application to run various operating systems on your PC. For example, I use it to run Linux mint under my Windows 10 pc.
Since it turned out in to a listing post, might as well recommend WFDownloader App. It already employs crawl delay at intervals during scraping and you can increase it in the general settings so as not to trigger instagram but the search will take longer.
If you want to batch download from kissanime, use WFDownloader App, as it can help you grab complete series. Also supports other sites like gogoanime, masterani, chia-anime etc.
Edit: you can watch this video demonstration that shows how to use with kissanime.ru.
I can't find what I used to use. It's free so I'll link it here when I find it. Until then, check these out. https://www.wfdownloader.xyz/blog/best-bulk-downloader-applications
Bulk Image Downloader is pretty great once you actually have a site chosen to download from. You can choose how deep you want to search in a page.
Have you tried wfdownloader app? I've used it to download galleries from deviantart in the past but that was a long time ago. You copy the url of a gallery e.g. hxxps://www.deviantart.com/auser/gallery/ and paste it in the software and it finds all the image links from that and puts it a batch that you can download.
WFDownloader App - A free multipurpose bulk downloader to easily bulk download from pinterest, instagram, search engines and other supported sites. It also has a forum media grabber and website crawler for customized downloads.
Looks like something doable with wfdownloader. Just select only documents or apply relevant filters before you search. See crawler tutorial.
What you need is a crawler/scraper tool, you could use wfdownloader app's crawler for this. Using your primary page, set the result filter to ".zip" to accept only zip files, and the crawl filter to "-free-" so that it crawls only pages containing that in their urls. Also set the crawl depth to 1, so that it doesn't crawl deeper than all directly linked pages. Click search, accept results and start the downloads. See image with the settings. I was able to get 224 results.
Since wget is proving difficult for you, you wont have to download everything manually if you're okay with using another tool called WFDownloader App. Use its crawler option, select "Documents" for result, and use custom crawl filters /file/ and /num/ (to speed up scan) as shown here, then click the search button. Got 289 pdf documents with their correct names as shown here.
If you are trying only chrome extensions, then it may be difficult to find something that does what you want. You may need to use a dedicated software for this. What you need is a bulk downloader application that supports the site you are trying to download from. This post shows a few good ones, hopefully one of them works for you.
If they were all on the same page it might have been possible with just wfdownloader app. For what you want to do, you'll need to use a crawler that supports logging-in to grab all the video links, then export all of them to use in a tool like jdownloader or youtube-dl. You can try its crawler, but first either import cookies or use the user login button. After that put vimeo in result filter so that it accepts only links with vimeo in it (Do not select the "video" option since I doubt it will work as the videos are embedded here). After the search, export the links to jdownloader to batch download all of the videos. Note that it may not work if the site uses too much javascript to load the videos.
It's possible to do this with wfdownloader app. You can use its forum option to download forum images, videos, attachments and so on. You'll need to adjust the settings based on the site.
I don't really understand what you are trying to say. You don't need to use crawler mode for tumblr in wfdownloader app because it is a supported site. Just copy and paste the link of the tumblr page into the app as shown in the bulk image downloader tutorial but use a tumblr link instead.
>the site look almost commercial
Can you tell me what makes you think this so that it can be removed? There's no catch, see faq. It's a hobby project I think will be useful to some.
There is also wfdownloader app which supports both reddit and twitter and you are right that the sites that are supported by each tool are a bit different. Also, they have different priorities.
I would suggest trying wfdownloader app and following this detailed instagram downloader tutorial. If it's about 300 posts, it should be able to get all. Note that you'll need to import cookies since saved posts are private.
If you are still looking for one, you could try this instagram downloader that works for single and bulk downloads. Just be careful not to overdo it since they rate-limit the process.
It's just instagram making it difficult to do this. If you're okay with an external application, you could try this instagram downloader. Hopefully, it works for you.
Might be possible to get this done via wfdownloader app's crawler using the "documents" option in your case. If you're not conversant with crawlers, it might be a bit technical for you.
WFDownloader App is a free multipurpose bulk downloader to help you easily bulk download images, videos, and other files from search engines, forums, social media, and other sites. See all features.
See this instagram profile downloader tutorial which shows downloading from instagram profiles. It also gives some tips to avoid common instagram issues.
Use a crawler that can scrape images like wfdownloader. Select images and apply appropriate filter so it crawls only the pages you want to download the images from.
You can try this bulk image downloader. You can either use its browser to login or import cookies from your browser so that it can work correctly. After that you can use any of the manual search methods (image, forum, or crawler), whichever of them is more appropriate.
What you need is a crawler software that can download videos. You can follow this wfdownloader app's crawler tutorial and select only the "videos" option in your case before starting the search. Might not work if the site uses external video sources that are hard to scrape.
You can follow this forum image download tutorial. There is an option to grab externally linked images.
Have you tried this artstation downloader although with all the other suggestions not working, I doubt if this one will, but you can try.
WFDownloader App is able to download from password protected sites. Go to crawler under manual search then select only the "video" option and nothing else. Use the "user login" button to log into the site (or alternatively import cookies from your browser) before you start the search.
If you don't mind using another software, you could try WFDownloader App may be you'd have better luck although it just could be reddit causing the limitation. Otherwise, you could use it to download from other supported wallpaper sites that might let you reach your target number.
Will take this opportunity to recommend WFDownloader App which is useful when you need to bulk download many images at once from forums, search engines and other supported sites like Pinterest, Imgur, Reddit, etc. It comes with quite a number of useful features.
WFDownloader App has a forum scraper that works for forum threads. Just select the "images" option. It will automatically handle paginated threads for you. There is also an option in case you also want to automatically pull externally embedded images/galleries from imgur, flickr, etc. You can read this forum scraper tutorial which goes into details on how to use it.
Thought you only wanted a cli app, but from your comments it seems you also don't mind a gui app. You could try wfdownloader app which can bulk download images from a number of supported sites like pinterest, imgur, flickr and so on. For some sites that support multiple resolutions or multipage galleries, it allows you to select those via a config button. And if the site is not supported, you could always use its manual search which can grab images from almost any page, works with forum threads or do advanced crawl search.
I tried it, it seems it's stuck in a loop for confirming captcha!
But it works for gogoanime and other ones I tried. You can check the supported websites list hereLink
Noticed you're not familiar with command line stuff. You could try wfdownloader app. It is has a gui where you can copy and paste the link of the deviantart gallery for it to find all the links.
If httrack is confusing for you and you don't mind using another application, you can try wfdownloader app. Use it's crawler mode. In your case, just select "images", then click the search button. Note that depending on how large the blog is, it may take a while.
You can try wfdownloader app, as it has a builtin forum downloader. Select "Images", then either set link category to external or set custom URL filter to "imgur.com" before you begin the search.
If it's among it's supported sites, wfdownloader app will do what you want. If it's not, you will have to do a manual image search and then use the "custom names" generation which will automatically number the images.
You can try wfdownloader app. Use the crawler mode and put the "/wiki/File" as a filter to make it return only those links as results.
Tried it with wfdownloader app's crawler and got over 10,000 videos before cancelling.
Before you start your search, first disable/uncheck "Skip pre-batch creation step" from General settings (or you won't be able to do step 3).
You can try wfdownloader app. It supports a number of popular sites natively and will automatically grab the expected images from them. Otherwise you can use its crawler for advanced image search.
WFDownloader App - A free bulk downloader in case you ever need to bulk download whole image galleries or any type of file. Supports popular sites like pinterest, imgur, reddit, deviantart, artstion, etc.
Can't help you with Bulk Image Downloader however, if you are willing to try another application, WFDownloader App seems to be able to pull the above images you wanted. See this picture after applying filter to the result. Use the manual search:
Note: the application is free and cross-platform.
If you don't mind using another application, you can use wfdownloader app's crawler feature for this. Set max depth to 2, and configure results' custom filter to accept only mega and mediafire links. After creating the batch, you can export the links to use in jdownloader.
WFDownloader App - A free bulk image downloader or general purpose bulk downloader that supports many websites. The tiny cross-platform version requires java, however, for the linux and mac versions you just extract and run.
You can use wfdownloader app's inbuilt crawler and apply an exe filter. Note that this requires a bit of knowledge on using crawlers.
Steps:
You can use this sample crawler tutorial to guide you more.
You can try wfdownloader app. Note that the search/crawl has been slowed down (5 seconds wait per request) so as not to trigger their rate-limit block. Because of this, you can click the "Confirm" button without waiting for the link search to complete, allowing you to focus your time on other things.
You can use wfdownloader app's crawler mode. Select images and set the max crawl depth to 1 (so it doesn't crawl deeper). There's also a filter option to refine the results. It's cross-platform, so you just need to use the mac version.
If you want to download a range of URLs/links (like what you've shown above), you can use wfdownloader app. See how to generate the links here. Your situation isn't very clear. Are all the links on a page or they scattered across many pages in which case it might be better to use its crawler feature which can crawl many pages and download only the selected types of links.
You can try any of these sites: gogoanime1.com, animekisa.tv, gogoanime.io or others in the faq. Many of the sites actually work, but if your ISP/country is blocking/censoring some of the sites or their video hosts, there is nothing the app can do and so you experience issues. 5/24 means that the other videos are missing. Many users do not check, but just assume the app failed to find the rest. So try any of the above recommended 3 sites.
WFDownloader App is a free and cross-platform bulk downloader that supports many sites which are listed in the faq. You can also configure its crawler for search on sites that are not directly supported.
I'll try to be as brief as possible. Not all anime sites are equal, some do a better job than others. Recently 4 major video servers (rapidvideo, streamango, openload, verystream) used by many anime sites shutdown so a lot of videos are missing right now. If it is not finding some episodes, it's possible they are missing and have not been reuploaded. Kissanime would have been a good source as they are very reliable in maintaining their videos however, they now require captcha so the site was not recommended with the others given earlier (Only use for animes you can't find anywhere else). Also if a site has changed since the last time it was added to the application, the download algorithm may no longer work. There is a dedicated contact form where users can report sites that are no longer working for them. Be sure to give as much details as possible.
Did you try the ones that were recommended earlier and they didn't work for you. A few more are 4anime.to, gogoanime.video and anime1.com.
"Service unavailable" could mean the video is temporarily down or unavailable.
If you want to bulk download from kissanime.ru directly, use wfdownloader app. You can choose the video quality you want (e.g. 480p, 720p and 1080p) and can also select the episode range you want for partial series download.
Though this is coming late, you can do the same with wfdownloader app for pc users. It supports animelist.pw natively so you just paste their link of the anime you want, select the video quality, and it bulk grabs everything.
Nyaa . si is a good torrent site, however since your internet is bad, and you don't care about quality, you can use wfdownloader app as an alternative. It can bulk download whole or partial anime series from kissanime.ru, goganime.io, animekisa.tv and many other anime streaming sites. In the config, you have the option to choose quality like 480p, 720p, etc. So you can get smaller file sizes per episode and use less internet bandwidth. You also don't have to be afraid of the links expiring because your internet is slow, the application will automatically refresh the links and resume them so you can finish your downloads at any time. It was actually made to cope with users having bad internet connections. Watch this video to see how to use it.
If it's from a paginated source page, and the site is popular, it could added to the list of supported sites of wfdownloader app making it easy for you to extract the links. Otherwise may be this octoparse tutorial is what you want.
You have few options:
There are also many other anime sites it download from. See their faq for all supported sites. Some sites may work better for you than others. For instance the search works very fast for gogoanime1.com.
There are a number reasons it fails to find all links. The common ones include:
If you are interested, you can check out this detailed guide on common link search issues.
You can right-click and select Save Video if it's just an episode you want. However if you want to bulk download entire manga collection or anime series quickly from the sites mentioned, you can use wfdownloader app. See how to bulk download anime and manga which works for both kissmanga, kissanime.ru, and many other supported sites.
Your guide is thorough, but permit me to provide another alternative for those who don't want to torrent, are afraid of typing commands (like this tutorial) but would still like to batch download anime. You can use wfdownloader app to batch download anime from streaming sites like 9anime.nl, kissanime.ru, animekisa.tv, and many other sites. It also allows you to set your preferred video quality for example 480p, 720p, 1080p (depending on what the site supports). You can also specify the episode range you want in the config for partial series downloads. You just copy the url/link of the anime you want, watch this short video.
It was already stated in the post above.
> Now has captcha handling for some sites that use it. Some countries or internet connections may have issues with google recaptcha. Just go to Options > General Settings and select "Enable easy google recaptcha mode" and then retry the link search.
Check overcoming google recaptcha issues for a detailed captcha solution for 9anime in wfdownloader app.
You can try wfdownloader app. The advantages are that it allows video quality selection (480p, 720p, 1080p), allows you to stop and resume the batch later and supports many other anime sites. Watch this 3 mins kissanime demonstration.
You can follow this sequential url batch download tutorial which seems to be about what you are trying to do.
wfdownloader bulks download anything from anime, manga, cartoons from many supported sites which is stated on their FAQ page. It even allows selecting the video quality (480p, 720p, etc) you want from kissanime.ru or 9anime.to. See sample usage.
Unfortunately, kissacartoon.ac took down (for whatever reason their F Server) which was what vn-ki downloader was downloading from. Now what only remains is their O Server, and the new H Server which are currently difficult to download from. Even wfdownloader is now having the same issue with kisscartoon.
If you don't mind bulk downloading from another cartoon website, you can use wfdownloader to bulk download from either animetoon.org, itsaturday.com, or toonova.net by following their anime batch download tutorial.
I will tryout this little weeb. Another cross-platform (works on windows, mac and linux) anime downloader is wfdownloader. It allows to bulk download complete anime episodes from many popular websites including kissanime.ru, masterani.me (RIP), gogoanimes.co, 9anime.ru and many more as stated in their faq. Also use to download complete manga chapters too. See video demonstration of it downloading from kissanime.
You can use WFDownloader. You basically go to any of its supported manga sites, copy the link url of the manga you want and paste in the application and it downloads the complete manga. See tutorial.
You also said to download so I'm guessing you also want to be able to read offline. Try PC app WFDownloader which can be found at https://www.wfdownloader.xyz. It can help download entire chapters and volumes and supports many sites such as goodmanga.net, mangapark.me, mangatown.com, mangago.me, mangahere.co, mangareader.net.