I updated Tartube's classic mode just yesterday.
The update clarifies how media formats are handled, and adds direct conversion of video formats (in addition to direct conversion of audio formats, which already existed).
I will upload it to github as soon as I've finished today's changes: https://github.com/axcore/tartube
I love the concept, and thank you for sharing this!
I use something similar for batches of images called, RipMe:
https://github.com/RipMeApp/ripme
RipMe is a Java (.jar) app that supports clipboard monitoring. You should take a look at the code for ideas on URL validation. It seems to me that you are on your way toward making a video downloading version of that app.
Note: RipMe CAN download videos, but it does not give you the control that youtube-dl does. A similar app (particularly with clipboard monitoring) that was specific to youtube-dl would be awesome. I'm no Java dev, but I'd be happy to help you out with ideas and testing.
You could try to find out if your Mullvad client supports split tunneling, you would then only activate it for yt-dlp. Alternativly you could set up a virtual machine and install mullvad and yt-dlp inside it.
So ads on YouTube videos come in 2 forms. The 1st is clickable ads that browser adblockers take care of (ads injected into the YouTube video by Google and aren't downloaded, because aren't part of the video).
The second is ads within the video itself like sponsors, interaction reminders (asking for likes/subscribes), intros, ending credits, etc. These types of "ads" are downloaded because they are within the video itself. For example in a YouTube video when the person in the video will say "before I get to explaining how to do xyz, I wanted to take the time to thank the sponsor for this video, blah blah".
Sponsorblock is a community driven database where users mark in videos when these in video advertisements start/end, which allows you to automatically skip that part of the video (using an add-on for your browser). Here is the website. If a video you are watching doesn't have sponsor segments identified, then you can mark the second yourself and submit them too the database right from the YouTube video window.
The sponsorblock integration for dlp uses a command like utility called sponskrub to do something similar for downloading YouTube videos. Whenever you download a YouTube video with sponsors/ads/etc. It will automatically use ffmpeg to cut those sections of of the downloaded videos.
In my case, kids videos are the worst for intro/outro/interaction reminders. So when I use dlp, as long as I add what type of sections I want cut to my config file, dlp downloads the video, cuts there parts of the video that are sponsors, etc. then splices the video back together for a clean experience for my kids.
Only works for YouTube, and only if there are sponsorblock segments identified for that video, but it works exceptionally well.
Here is some information on why interpreted code is not faster than compiled code
In general, this is a bad idea, because then Tartube won't know where to find the videos. To give one example, video thumbnails are sometimes downloaded directly without using youtube-dl, and in this case they would be downloaded into a different folder than the videos.
If you don't care about all the extra functionality, and are only interested in downloads, then of course output templates are perfectly ok.
Tartube can change the location into which it downloads videos, for any users who really need it. It's explained here: https://github.com/axcore/tartube#617-combining-channels-playlists-and-folders
As, /u/EinEindeutig said, what Windows shows in its file properties details tab is not the same thing as the full metadata fields/tags that may be present in a media file.
I highly recommend installing the tool called "MediaInfo" from here:
Good to hear you got it working! :)
> I also have mutagen-1.45.1 as both a folder, which itself contains five folders, and as its original .tar.gz file. There's no .exe for this one, but there're plenty of other little files, including a .py, and many others that don't have any extensions.
You don't need mutagen on Windows. It's already built in to yt-dlp.exe
.
In fact all the needed Python stuff is built in (that's why the Windows .exe is so much bigger than the Unix one).
> Should I install Python?
Not needed for yt-dlp to work; see above.
(unless you want to build yt-dlp yourself of course, which is what I do when there are interesting changes in the source code, that I want before the next release version comes out)
> Earlier today, I installed the K-Lite_Codec_Pack_Mega. > > That won't help with anything yt-dlp related, will it?
No, that's only for being able to play all sorts of media files.
But if you play them with e.g. VLC, even that codec pack is not needed, because VLC has the codecs built in.
according to nordvpn themselves there's 29 socks servers at the moment. out of over 5000 servers in total. like i said, "most" are down, because there used to be more.
which server are you using?
edit: also... might help to post error message too.
Interesting. It may depend on what information is being leaked to iplayer by your machine. I know that from my machine, using NordVPN, iplayer refuses to allow the download unless I change the timezone. I've tried this multiple times, where I forgot to change the timezone before trying to download and was refused permission, but was able to download after making the timezone change.
That has nothing to do with it.
So are you just lazy? The very first Google entry for data scraping python is
https://www.freecodecamp.org/news/web-scraping-python-tutorial-how-to-scrape-data-from-a-website/
It is far from the only entry.
You've already said you have some python knowledge, so why not apply it.
We can't all know everything and we have to learn. There is no problem with that. But most people will tend to try and do stuff with their knowledge first, or when they ask for help at least be precise with their needs rather than "I want to scrape data", and say what they have already looked into, tried, or relevant stuff like knowledge, platform, or anything.
I'm leaving this here. I've wasted enough time on this matter.
Reddit bots constantly delete this post because I changed a link. I contacted admins and they restore it but bots do their job again and again. I'm so much sorry about that. If you need a link, here it is. Hope this comment won't be removed by the same relentless bots. BTW, Notion will be undergoing scheduled maintenance this Friday, April 16 at 5:00PM Pacific Standard Time, and will be unavailable for a few minutes. In case if someone will try to access it anytime soon.
Try this,
First get Material Files from [F-Droid] [Play Store] (Other file managers should work too, but this is what I use)
Open the left sidebar and select Add storage -> External Storage. This should now open Android's default file manager. From here, again open the left sidebar and you'll see Termux as an external storage option. Select it and click on Use This Folder and allow Material Files to access this folder.
Now any files belonging to Termux should appear in this folder. Now just create the .config folder and put your yt-dlp.conf file there as I said earlier.
(j'avais pas vu ta réponse)
​
Sur leur site ils explique que c'est faisable sur Linux :
Après j'ai pas testé, mais tu peux tenter le coup !
If you want a GUI solution, you could use Tartube (https://github.com/axcore/tartube).
Add the channel, then click the Check all button which will fetch a list of videos. Then just select the ones you want and download them.
There seems to already be an open error about this on GitHub
https://github.com/axcore/tartube/issues/371
So, no reason to panic. I will read this! Thank you so much for your help and support!
Even faster than -N
is using aria2c as an external downloader with the command --downloader aria2c
.
​
you can do that by using Jdownloader2's link grabber.
https://jdownloader.org/jdownloader2
it can also use ffmpeg to convert/transcode videos and audio files.
I don't think moving from Github is the end of the world for the project, there are plenty of code mangement sites or they could do like in the "old days" with mailing lists and ftp sites. Just my 2 cents.
It can be converted to source usig these commands:
convert -depth 8 01.png rgb:ytdl01.part; \
convert -depth 8 02.png rgb:ytdl02.part; \
cat ytdl01.part ytdl02.part > youtube-dl2020.09.20.tar.gz; \
rm ytdl01.part ytdl02.part; \
clear; \
print 'sha256 checksum: \n'; \
sha256sum youtube-dl2020.09.20.tar.gz
are you looking for a single proxy or the option of hopping between different countries?
if single proxy, a cheap vps with tinyproxy is a fairly simple setup you can host yourself.
anyways, i don't know many proxy providers - i knew of NordVPN which offered proxies but they've been phasing them out.
Not for me [generic] @christianmohr009: Requesting header WARNING: Falling back on generic information extractor. [generic] @christianmohr009: Downloading webpage [generic] @christianmohr009: Extracting information ERROR: Unsupported URL: https://www.tiktok.com/@christianmohr009
2020.03.06
i think he mean b-code, not p-code, but same same...
it's the visible code in the URL:
https://www.bbc.co.uk/iplayer/episode/m000gpnx/defenders-uk-series-3-episode-3 (m000gpjx)
https://www.bbc.co.uk/iplayer/episode/b0bqmxg1/black-hollywood-theyve-gotta-have-us-series-1-3-black-is-the-new-hollywood (b0bqmxg1)
>youtube-dl downloads URLs. One channel = one URL. One URL = one simultaneous download.
You can't download 4 videos from the same channel simultaneously, because Tartube doesn't know the URL of each video.
If you want to download four videos from the same channel, simultaneously, then do this:
In Tartube's main window, left-click the channel and select "Check channel"
When Tartube finishes checking the channel, it knows the URL of each video.
Select multiple videos, then right-click the videos and select "Download videos"
OR
Custom downloads are explained in the FAQ: https://github.com/axcore/tartube#custom-downloads
Are you running the .exe or the python script?
Are you running youtube from the same directory it exists in, or are you calling it from a different directory?
Have you tried searching your filesystem for the file? If you arent a fan of searching for files from the commandline, I recommend a utility app called "Everything" from VoidTools:
Thank you so much! I picked apart each flag/option from your provided code and was able to reference it all in ffmpeg's documentation except the -c:a
part and the {}
part.
Am I correct in inferring that is saying the flag for the audio codec choice, meaning that -c:a copy
tells ffmpeg to use the existing encoding type for the audio codec?
And are the curly brackets necessary if nothing is being passed through inside them? Sorry if that's a stupid question!
Also, this is outside of the scope of my original question, but do you have any idea if ffmpeg is noticeably faster than at re-encoding video to x265 than Handbrake? Based on Handbrake's documentation, it uses ffmpeg to do it's encoding, which leads me to believe both ffmpeg at the command and Handbrake via it's GUI will take essentially the same time to encode, however this website lists Handbrake as being "fast", as compared to ffmpeg.
Would I be right to assume that you haven't updated homebrew in a while, maybe years?
You could try brew doctor
and see if you can fix the errors it lists. Or re-install homebrew from https://brew.sh. Or try another method to install ffmpeg, if you can't fix homebrew.
That's the main "youtube-dl" project. It has its own website address. However, both projects are listed on GitHub and that is where they physically reside. youtube-dl.org is simply an official promotional website that makes the main project easier to find and learn about.
Any ffmpeg build should work, as long as it is relatively up-to-date. I otherwise don't know enough about ffmpeg to answer any questions about encoders that it uses. That would probably be a better question to post on /r/ffmpeg.
it's uppercase u. the lowercase u is short for --username
youtube-dl -U
or youtube-dl --update
from --help
:
-u, --username USERNAME Login with this account ID -U, --update Update this program to latest version.
also, https://youtube-dl.org/ works for me... alternatively, you can go straight to github: https://github.com/ytdl-org/youtube-dl/ and look under releases
in the right column
this sub-reddit is about youtube-dl, a command-line tool. if you're looking for something else, i don't know what. there might be android apps that adds a graphical user interface on top, but i don't use android anymore, so i don't know of any.
yeah, that's not the latest. 2021.04.17
is the latest.
i'd suggest uninstall your version, and grab the single binary file from https://youtube-dl.org/
see download instructions for two simple commads to get it
It's not always that bad,
lizzie@pi ~> time curl -sS --compressed 'https://youtube-dl.org/download.html' | rg -o 'SHA256 [0-9a-f]+' | head -1 | cut -d\ -f2 0f7b9dcb45bd9afcbc8585e9743ea6b23ed3091e1f9f9692a2da44d85302878d
________________________________________________________ Executed in 608,55 millis fish external usr time 348,75 millis 0,00 millis 348,75 millis sys time 47,37 millis 6,67 millis 40,70 millis
Also, you can download multiple videos at once with youtube-dl to avoid pinging the servers, I use youtube api to put the links of new videos from the channels I want to archive into a txt file and then one youtube-dl instance downloads them.
It would be worse if you launch youtube-dl to watch videos in your video player though.
The link you pasted downloads the file from same location as the page I linked and gives the same hashes (I just checked now). The page I linked in my post is the one you'll get redirected from https://youtube-dl.org/latest .
It can fill up your disk if you use it too much, and it may lead to serious distractions if you continually watch all the things you download with it. Apart from that, yes it's "safe" as in it doesn't contain any virus or malware - in fact, it can help to avoid seeing ads too. Like any tool it can be used for good or bad purposes.
You can get it from https://youtube-dl.org/ as linked in the side bar over there ==>>
I strongly suggest you read the documentation on that site, or watch some videos that explain how to use it.
youtube-dl is for downloading videos. If you want a similar tool for images, then try gallery-dl. Or if you want a simpler GUI maybe try ripme.jar:
instaloader is the big one but it's commandline, no gui.
before i used instaloader i used a paid GUI tool from 4k
It sounds like you have an mps-youtube problem, and not a youtube-dl problem.
What is this version issue, and how do you know what it is? Is this a bug reported to the mps-youtube GitHub?
I think is the same person who posted this thread. To reply to other questions:
youtube-dl runs inside a thread. If nothing happens when Tartube runs youtube-dl, then the thread returns no indication of what went wrong. In that situation, Tartube produces a "download did not start" message. 99.9% of the time the reason is that youtube-dl's binary is not in the user's PATH, or the user has specified a non-existent binary, so changing the settings in Edit > System preferences... > Downloaders . File paths will fix it.
To completely uninstall Tartube, just delete the installation folder, which by default is C:\Users\YOURNAME\AppData\Local\Tartube\.
Max downloads = number of threads. If you're only seeing activity in one thread, perhaps there's an internal error. Try running Tartube from inside a terminal window so we can see any python errors being generated. If you're not sure how to do that on MS Windows, there are instructions here:
https://github.com/axcore/tartube#71-tartube-wont-installwont-rundoesnt-work
If you want a GUI solution, Tartube https://github.com/axcore/tartube can remove either the sponsored section or everything but the sponsored section.
(I am resurrecting an old thread because the video pasted below is no longer available).
Can you see anything else in the Output tab, besides that text?
If not, that suggests there's an invisible python error, so you should check for that. Run Tartube from inside a terminal window, using these instructions:
https://github.com/axcore/tartube#71-tartube-wont-installwont-rundoesnt-work
Then tell me what text you see inside the terminal window
good summary...
probably worth mentioning tartube, which supports replacing the downloader as well.
the fix they're talking about is in youtube-dlc, not original youtube-dl. youtube-dlc released a new version today, so only need to re-download the file.
i don't remember how yt-dlg is setup, is there an .exe there you can replace? if not, then you're kinda screwed.
yt-dlg is not updated anymore as far as i know.
tartube might be a good replacement, as it supports using youtube-dlc as your downloader.
Tartube's source code contains comprehensive instructions for creating a new Windows installer, in case anyone needs to do that. It might take 20-30 minutes but it's pretty simple.
https://github.com/axcore/tartube/blob/master/nsis/tartube_install_64bit.nsi
I don't understand the need for this anonymous hosting of the 64-bit Windows version of tartube. All of the downloads for tartube can be found here (backend hosting via SourceForge):
With shutterencoder you can change container (mkv to mp4 and others) without recoding.
It is an opensource program and works excellent also shutterencoder uses ffmpeg inside for everything
There's another dimension...
^(This is something important people should know about a/v files.)
There are codecs and containers
MP4, WEBM, MKV for example are containers. Containers just contain compressed or uncompressed audio and/or video streams and an contain also other data like subtitles.
A Codec is a definiton how audio/video is stored and compressed.So the Container is responsible for compression and quality.
Codecs for example are H264, H264, MP3, AAC, OPUS, ...
Some containers (like mp4 and webm) are restricted for specific codecs to ensure compatibility.
MKV for example can hold almost everything.
​
You can check with -F
in which formats (codec) video/audio is available.
With -f
you have fine-grained control over which formats youtube-dl will download and mux into a suitable container.
Remuxing (putting streams into another container) won't degrade audio/video quality.
Have you tried TinyMediaManager https://www.tinymediamanager.org/? I use to use Plex but switched to Emby. TMM will lookup episode info and write that to an nfo file as well as rename the episodes and move them into season folders. Emby then accepts TMM's renamed format.
listen op I was in the same situation as you where in. But it takes a bit of time initially and can be a bit confusing. I would recommended you watch this video at least to understand how to do the steps. you don't need to understand command line or code, not even using Linux. Because trust me it saves alot of time. But if you don't want to do that there is newpipe witch does the same exact thing on android and is far more friendly to new comers.
seeing this on programs that rely on youtube-dl for playback (WACUP e.g), most work but i hit one instance where it refused to play, trying it a second time made it work again
this is bad, really bad
Nice project, there is a free GUI i developed which is more than this checkout https://github.com/keshavbhatt/olivia would be thankful to you if you add to "what already exists" section of your readme.
To answer your question: It depends on which VPN you are using and it depends on how aggressively someone tries to identify you.
If your VPN is no-logs and doesn't cooperate with search warrants, then yes - Google or anyone else won't be able to identify you.
If you use a VPN that does log and/or cooperates with search warrants, then you could be tracked. And there is also the issue of "DNS leaks":
Always test your VPN for leaks!
If --geo-bypass
doesn't work, then you will have to use a VPN. Windscribe offers a VPN service that gives you X ammount of free hours per month. You could test with that, and even use it for free monthly if your usage doesn't require more than their free minimum.
https://windscribe.com/features/use-for-free
I occasionally use it for free. It works. But the free version doesnt give you full access to all the global points of egress. You only get access to a limited set.
I'm just saying it's a bad choice of technology to do something like this in Excel with VBA macros.
Get Visual Studio, create a Windows Forms Desktop App for .Net, pick the language of your choice, e.g. Visual Basic and click together the same application with the same functionality but outside of an Office/macro environment.
Not saying that's better, because he's still able to add stuff to the software that we might not want, but it's for sure the better choice in technology and better approach.
Also you can do more, learn more and are on the right path. VBA isn't exactly the future of software development ;-P
Are you re-connecting when doing this?
Some NordVPN servers are blocked by iplayers, others not. I use NordVPN just fine with a CE(S)T timezone set.
But fact remains that these tools do send any timezone or clock information to BBC's servers. They're normal http requests.
Even using iplayer in the browser works fine without it, though there you (often/always?) need to create an account, with fake UK data.
So, unless NordVPN re-connects when you change these things, I don't know how to explain your experience, but it's not a common one at least.
No errors, or I would have written them, that's why no verbose log too, as everything appears normal. Just that it isn't. Do you hold it for possible that YouTube throttles just because of the fact I use a VPN (ProtonVPN). I think it's safer regarding legal issues, but I've heard about measures (like when you get a captcha for a google search).
Every day I go through my video subscriptions and download between 50-100 videos, using youtube-DLG usually, except for my recent experiments with yt-dlp. As I mentioned, I throw the URLs into a text file (just to save them for editing for restarts or for use as a batch file), then past the URLs into youtube-DLG which runs youtube-dl. Tests with using the text file as a batch file with yt-dlp didn't change the situation. Usually, when the throttling starts - which sometimes is on the very first few videos downloaded - I determine which URLs have been downloaded, edit them out of the text file, close youtube-DLG, restart it, paste the remaining URLs into it and restart the downloads. This gives me full speed for usually one or two out of the three videos at a time that DLG downloads. One or two of those videos may throttle immediately or not. After that, Usually one video of the three will come down at full speed, with the rest being throttled. Eventually all three videos are throttled, at which point I do another restart to regain speed (or not - I just let it run while I do other things.)
The main point is that if I run the text file as a batch file with yt-dlp, I download one video at a time at full speed, but eventually the videos still become throttled. This occurs probably around 10-20 videos into the batch file. Then I can restart, and sometimes I get full speed again and sometimes I don't.
I tried varying my IP with NordVPN, but it didn't seem to help. It just seems that Youtube is tracking how many videos are coming down to the same IP and simply throttled everything after a certain number have been sent, either simultaneously under DLG or sequentially under yt-dlp.
For those recommending youtube-dlp as the fix: nope. I'm using it right now, and with Xfinity Essentials bandwidth of 50MB/s, I'm getting mostly under 1MB/s. If I run either youtube-dl or youtube-dlp, I get throttling after the first one or two videos. When running youtube-dl-gui, which downloads 3 videos at once, two will get throttled and the third will run at full speed until completed. Then when the next video starts, it gets throttled, too. I've tried running with NordVPN changing my IP, and running without the VPN, no difference.
Frankly, there appears to be zero fixes available for this issue.
Hey, I came across this post while searching for a similar issue I'm having.
I'm not in australia but I am using NordVPN to connect to an AUS endpoint. Trying to play videos on SBS On Demand works, but I get a "This content is not available in your location" error message when trying to download through yt-dlp.
Any ideas or suggestions on how to get this to work?
--rm-cache-dir
is useless, the only thing youtube-dl caches are some javascript de-obsfuscated youtube stuff.
i get the same error as you do with youtube-dl.
testing with yt-dlp and --allow-unplayable-formats
to check if DRM'd, i get a geo restriction error, while on NordVPN australia endpoint.
are you in australia or using a vpn?
Yes, this is exactly what I am getting. Using the browser I was able to play the content only usually stops right after displaying the first ad.
I have tried 4 different VPN providers and nothing works: Tunnelbear, Nordvpn, Expressvpn and VyprVPN.
if your looking to get the order, titles, links and etc from a playlist im not sure. there are some smaller projects that make gui's for youtube-dl but they usually also restrict what you can do with it (typically focused around actually downloading rather than just getting metadata)
I made a gui program for downloading/syncing playlist to an android phone but idk if its what your looking for:
https://play.google.com/store/apps/details?id=org.princeofpuppers.sync_dl_gui
u/wierd - I'm using the Linux terminal NordVPN executable, so ">nordvpn [global options] command [command options] [arguments...]" in a terminal. I also use my own connection scripts AND proxies manually added in the Network Manager or in apps that provide proper proxy options. There is no secret, I simply don't need you, or anyone else, to test my VPN connections for me. I'm aware of the current NordVPN issues with SOCKS5 I'm quite capable of confirming they are working, thank you.
I've tried numerous NordVPN server types, not only SOCKS5; To date, no NordVPN server of any type has worked with youtube-dl when attempting to connect by command line as described in my OP. As I've already told you clearly -- my nordvpn connections are working and stable at all other times EXCEPT when trying to connect youtube-dl with terminal commands.
I've replicated this behavior time and again with numerous nordvpn servers of all types. We've already established that my command syntax is correct. I've confirmed that my credentials are correct. In all scenarios, the multiple nordvpn server connections I've used work fine when youtube-dl commandline is taken out of the calculation.
So, you and I disagree that the nordvpn SOCKS5 servers are the cause of my failed connections trying to connect youtube-dl to a valid VPN sever with proper terminal commands and credentials. I thank you for your efforts, but unless you have some other solution to suggest. It's time to move on. TBH, it takes me about 5 seconds on the keyboard to initiate a solid, reliable VPN connection on my system, then open youtube-dl GUI, so it's not like I'm pulling my hair out here; I'm just curious about why youtube-dl commandline doesn't seem to be working.
I am using several different SOCKS servers. Each of them are working as confirmed by connecting to them using NORDVPN linux terminal app commands. There is no error message; youtube-dl simply does not work. I can connect to the very same SOCKS server using NordVPN terminal commands, then use youtube-dl without problem.
The error I get when attempting to connect with terminal as decribed in my OP is:
File "", line 126, in recvall raise EOFError('{0} bytes missing'.format(cnt - len(data)))
EOFError: 2 bytes missing
Error in sys.excepthook:
Traceback (most recent call last):
File "", line 153, in apport_excepthook
with os.fdopen((pr_filename,
FileNotFoundError: [Errno 2] No such file or directory: '/var/crash/_usr_bin_youtube-dl.1000.crash'
Hmmm I've looked into the code a bit and it seems youtube-dl uses the standard Python urllib/urllib2 to handle the HTTP/HTTPS connections and proxying, and I've found lots of posts about that not even being able to connect through to HTTPS URLs at all (i.e. using the CONNECT method with a HTTP proxy), without additional hacks. So I guess either that's been fixed at some point or youtube-dl incorporates one of those hacks, because that's exactly what it does (it seems http/https in the proxy URL given to youtube-dl is only used to tell it to use one proxy server for connections to plain HTTP URLs and a different one for HTTPs URLs - but in both cases the connection to the proxy server itself is plain HTTP, and if you only specify a HTTP proxy URL then it uses that one in both cases anyway)
Connecting via an SSL connection to the proxy server itself (as is needed by the NordVPN servers on port 89) seems to be a relatively new and non-standard thing:
And I can't find anything about anyone even trying to get urllib to do that so far, and I don't know Python well enough to even attempt to hack that myself right now :/
(Well ok, I did find this one StackOverflow question, but the only person who answered clearly didn't understand the situation, and the original poster seems to have deleted their comments: )