4070 commits

Author	SHA1	Message	Date
pukkandan	be6202f12b	Subtitle extraction from streaming media manifests #247 ... Authored by fstirlitz Modified from: https://github.com/ytdl-org/youtube-dl/pull/6144 Closes: #73 Fixes: https://github.com/ytdl-org/youtube-dl/issues/6106 https://github.com/ytdl-org/youtube-dl/issues/14977 https://github.com/ytdl-org/youtube-dl/issues/21438 https://github.com/ytdl-org/youtube-dl/issues/23609 https://github.com/ytdl-org/youtube-dl/issues/28132 Might also fix (untested): https://github.com/ytdl-org/youtube-dl/issues/15424 https://github.com/ytdl-org/youtube-dl/issues/18267 https://github.com/ytdl-org/youtube-dl/issues/23899 https://github.com/ytdl-org/youtube-dl/issues/24375 https://github.com/ytdl-org/youtube-dl/issues/24595 https://github.com/ytdl-org/youtube-dl/issues/27899 Related: https://github.com/ytdl-org/youtube-dl/issues/22379 https://github.com/ytdl-org/youtube-dl/pull/24517 https://github.com/ytdl-org/youtube-dl/pull/24886 https://github.com/ytdl-org/youtube-dl/pull/27215 Notes: * The functions `extractor.common._extract_..._formats` are still kept for compatibility * Only some extractors have currently been moved to using `_extract_..._formats_and_subtitles` * Direct subtitle manifests (without a master) are not supported and are wrongly identified as containing video formats * AES support is untested * The fragmented TTML subtitles extracted from DASH/ISM are valid, but are unsupported by `ffmpeg` and most video players * Their XML fragments can be dumped using `ffmpeg -i in.mp4 -f data -map 0 -c copy out.ttml`. Once the unnecessary headers are stripped out of this, it becomes a valid self-contained ttml file * The ttml subs downloaded from DASH manifests can also be directly opened with <https://github.com/SubtitleEdit> * Fragmented WebVTT files extracted from DASH/ISM are also unsupported by most tools * Unlike the ttml files, the XML fragments of these cannot be dumped using `ffmpeg` * The webtt subs extracted from DASH can be parsed by <https://github.com/gpac/gpac> * But validity of the those extracted from ISM are untested	2021-04-28 19:02:43 +05:30
Felix S	e8f834cd8d	[threeqsdn] Extract subtitles from streaming manifests	2021-04-28 17:24:50 +05:30
Felix S	e0e624ca7f	[canvas] Extract subtitles from streaming manifests	2021-04-28 17:24:19 +05:30
Felix S	ec4f374c05	[wat] Extract subtitles from streaming manifests	2021-04-28 17:24:08 +05:30
Felix S	c811e8d8bd	[atresplayer] Extract subtitles from streaming manifests	2021-04-28 17:23:56 +05:30
Felix S	b2cd5da460	[francetv] Extract subtitles from the HLS manifest	2021-04-28 17:23:47 +05:30
Felix S	2de3b21e05	[uplynk] Extract subtitles from HLS manifests	2021-04-28 17:23:37 +05:30
Felix S	4bed436371	[twitter] Extract subtitles from HLS manifests	2021-04-28 17:23:27 +05:30
Felix S	efe9dba595	[srgssr] Extract subtitles from HLS manifests	2021-04-28 17:23:16 +05:30
Felix S	47f4203dd3	[nytimes] Extract subtitles from HLS manifests	2021-04-28 17:23:05 +05:30
Felix S	015c10aeec	[roosterteeth] Use common code for subtitle extraction	2021-04-28 17:22:56 +05:30
Felix S	a00d781b73	[elonet] Use common code for subtitle extraction	2021-04-28 17:22:45 +05:30
Felix S	0c541b563f	[tv4] Extract subtitles from streaming manifests	2021-04-28 17:22:36 +05:30
Felix S	64a5cf7929	[byutv] Extract subtitles from streaming manifests	2021-04-28 17:22:27 +05:30
Felix S	7a450a3b1c	[generic] Extract subtitles from direct SSTR manifest links	2021-04-28 17:22:18 +05:30
Felix S	7de27caf16	[generic] Extract subtitles from direct DASH manifest links	2021-04-28 17:22:07 +05:30
Felix S	c26326c1be	[generic] Extract subtitles from direct HLS manifest links	2021-04-28 17:21:55 +05:30
Felix S	66a1b8643a	[downloader/ism] Support muxing TTML subtitles	2021-04-28 17:21:45 +05:30
Felix S	15828bcf25	[downloader/hls] Handle MPEG-2 PES timestamp overflow	2021-04-28 17:21:35 +05:30
Felix S	333217f43e	[downloader/hls] Remove duplicate cues using a sliding window of candidates	2021-04-28 17:21:26 +05:30
Felix S	4a2f19abbd	[downloader/hls] Assemble single-file WebVTT subtitles from HLS segments	2021-04-28 17:21:14 +05:30
Felix S	f6a1d69a87	[extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks	2021-04-28 17:20:29 +05:30
Felix S	fd76a14259	[extractor/common, downloader/ism] Extract SSTR subtitle tracks ... _parse_ism_formats was extended into _parse_ism_formats_and_subtitles; all direct users were updated, though _extract_ism_formats was left as a compatibility wrapper. The SSTR downloader was also modified in order to prepare for muxing subtitle streams, although no support for any subtitle codecs was added in this commit.	2021-04-28 17:20:20 +05:30
Felix S	171e59edd4	[extractor/common] Extract DASH subtitle tracks ... _extract_mpd_formats and _parse_mpd_formats were extended into _…_formats_and_subtitles; wrappers with old names are provided for compatibility.	2021-04-28 17:20:11 +05:30
Felix S	a0c3b2d5cf	[extractor/common] Extract HLS subtitle tracks ... _extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles and extended to handle subtitle tracks instead of skipping them; a wrapper with the old name is provided for compatibility. _parse_m3u8_formats is likewise renamed and extended, but without adding the compatibility wrapper; the test suite is adjusted to test the enhanced method instead.	2021-04-28 17:19:57 +05:30
Felix S	19bb39202d	[extractor/common] Generalise _merge_subtitles ... This allows modifying a subtitles dictionary in-place.	2021-04-28 17:19:46 +05:30
Felix S	d4553567d2	[downloader/ism] Prevent writing the header again when resuming an interrupted download	2021-04-28 17:19:37 +05:30
Felix S	4d49884c58	[downloader/fragment] Allow persisting extra state when a download is interrupted	2021-04-28 17:19:31 +05:30
Felix S	5873d4ccdd	[utils] Improve bug_report_message ... Add an optional argument specifying the text that should go before the message.	2021-04-28 17:19:23 +05:30
Hadi0609	db9a564b6a	[zee5] Fix extraction for some URLs (#279) ... Closes: #278	2021-04-28 14:51:54 +05:30
Felix S	c72967d5de	[mediasite] Generalize URL pattern (#275) ... Authored by: fstirlitz	2021-04-26 17:23:20 +05:30
pukkandan	598d185db1	Fix case sensitivity of format selector ... Bug introduced in f8d4ad9ab0	2021-04-26 10:56:56 +05:30
pukkandan	b982cbdd0e	[limelight] Obey allow_unplayable_formats	2021-04-26 10:56:55 +05:30
pukkandan	6a04a74e8b	[FormatSort] Fix for when some formats have quality and others don't	2021-04-26 10:56:54 +05:30
pukkandan	88728713c8	Py2 compatibility for FileNotFoundError	2021-04-26 10:56:53 +05:30
CXwudi	6b1d8c1e30	[niconico] Fix title and thumbnail extraction (#273) ... Authored by: CXwudi	2021-04-26 08:23:57 +05:30
Ashish	87c3d06271	[Mxplayer] Add MxplayerShowIE (#270) ... Authored by: Ashish0804	2021-04-26 08:12:51 +05:30
pukkandan	915f911e36	[utils] Encode URLs in YoutubeDLCookieProcessor ... Closes #263	2021-04-24 19:20:07 +05:30
pukkandan	cf9d6cfb0c	[tubi] Raise "no video formats" error when video url is empty ... Related: #266	2021-04-24 17:52:33 +05:30
pukkandan	bbed5763f1	[francetvinfo] Improve video id extraction ... Closes #261	2021-04-23 00:01:09 +05:30
pukkandan	ca0b91b39e	[version] update :ci skip all	2021-04-22 17:30:36 +05:30
pukkandan	e58c22a0f6	[documentation] Fix typos	2021-04-22 16:54:44 +05:30
pukkandan	1bdae7d312	Update to ytdl-commit-7e8b3f9 ... [youtube] Remove unused code 7e8b3f9439	2021-04-22 16:54:07 +05:30
Felix S	a471f21da6	[mildom] Remove proxy (#260) ... Closes #251 Makes 2cff495997, ab406a1c0e, #252 obsolete Authored by: fstirlitz	2021-04-22 16:52:22 +05:30
pukkandan	6efb071135	[BilibiliChannel] Fix pagination ... Closes #222 ccca21d7f5 Coauthored by: nao20010128nao, pukkandan	2021-04-22 04:19:33 +05:30
pukkandan	a439a3a45c	Improve output template (see desc) ... * Objects can be traversed like `%(field.key1.key2)s` * A number can be added to the field as `%(field+n)s` * Deprecates `--autonumber-start`	2021-04-22 04:19:33 +05:30
pukkandan	26e2805c3f	Add option --skip-playlist-after-errors ... Allows to skip the rest of a playlist after a given number of errors are encountered	2021-04-22 02:16:31 +05:30
pukkandan	3b4775e021	[go] Fix _VALID_URL ... Closes #255	2021-04-21 15:43:53 +05:30
pukkandan	ab406a1c0e	[mildom] Warn user of proxy	2021-04-21 15:43:22 +05:30
pukkandan	a3faeb7de4	[MetadataFromField] Improve regex and add tests	2021-04-21 11:12:04 +05:30
pukkandan	8c54a3051d	[youtube] Bugfix in _extract_ytcfg	2021-04-21 10:37:24 +05:30
pukkandan	c32b0aab8a	Improve --sub-langs (see desc) ... * Treat `--sub-langs` entries as regex * `all` can be used to refer to all the subtitles * the language code can be prefixed with `-` to exclude it * Deprecates `--all-subs` Closes #253	2021-04-20 02:58:03 +05:30
pukkandan	3097d9e512	[mildom:user:vod] Download only necessary amount of pages	2021-04-19 11:41:49 +05:30
pukkandan	c1df120eda	[mildom:vod] Remove proxy ... * Proxy is needed only for live videos	2021-04-19 11:41:40 +05:30
pukkandan	2cff495997	[mildom] Change proxy ... Related: #251 Closes #252	2021-04-19 11:41:33 +05:30
pukkandan	d0491a1ebe	[twitcasting] Fix extractor ... * `Origin: https://twitcasting.tv` must be sent when requesting the webpage. Otherwise the extracted `m3u8` will always give a `502` * Fix regex for when `data-movie-playlist` is a dict containing the needed list * media initialization is fully supported; so change downloader to native Closes #220	2021-04-18 17:57:46 +05:30
nixxo	b9d68c199b	[rai] Add support for http formats (#208) ... Authored by: nixxo	2021-04-17 22:42:28 +05:30
pukkandan	201c145953	Update to ytdl-commit-9f6c03 ... [cbsnews] Fix extraction for python <3.6 9f6c03a006	2021-04-17 08:40:31 +05:30
pukkandan	5d34200268	[youtube:tab] Reload with unavailable videos for all playlists ... If the unavailable video is in a later page, the warning and button are not shown in the initial webpage So we force all playlists' initial page to reload with the correct params	2021-04-17 08:40:30 +05:30
pukkandan	b7da73eb19	Add option --ignore-no-formats-error ... * Ignores the "no video format" and similar errors * Experimental - Some extractors may still throw these errors	2021-04-17 08:40:30 +05:30
pukkandan	6a39ee13f7	Fix inconsistent use of report_warning	2021-04-17 04:16:41 +05:30
pukkandan	33245766ab	[downloader] Fix ffmpeg selection for m3u8_native	2021-04-17 04:15:56 +05:30
coletdjnz	358de58c4d	[youtube:tab] Show unavailable videos in playlists (#242) ... Closes #231 Authored by: colethedj	2021-04-17 04:09:08 +05:30
pukkandan	a7191c6f57	Fix some linter and typos	2021-04-16 05:31:47 +05:30
lkho	baa5873942	[viu:ott] Fix extractor (see desc) ... * add language_flag_id query param * add support for premium account (untested since I dont have a premium account) * support entire series Code from: https://github.com/blackjack4494/youtube-dlc/pull/211 https://github.com/ytdl-org/youtube-dl/pull/15182 https://github.com/ytdl-org/youtube-dl/pull/26775 Fixes: https://github.com/yt-dlp/yt-dlp/issues/219 https://github.com/ytdl-org/youtube-dl/issues/27946 https://github.com/ytdl-org/youtube-dl/issues/27863 https://github.com/ytdl-org/youtube-dl/issues/27812 https://github.com/ytdl-org/youtube-dl/issues/27464 https://github.com/ytdl-org/youtube-dl/issues/26788 https://github.com/blackjack4494/yt-dlc/issues/136 Possibly also fixes (untested): https://github.com/ytdl-org/youtube-dl/issues/16992 https://github.com/ytdl-org/youtube-dl/issues/26701 Co-authored by: lkho, pukkandan	2021-04-16 05:19:46 +05:30
pukkandan	c6ce815461	[Exec] Ensure backward compatibility when the command contains %	2021-04-16 05:19:44 +05:30
coletdjnz	79360d99d3	[youtube] Standardize API calls for tabs, mixes and search (#245) ... Authored by: colethedj	2021-04-15 16:52:59 +05:30
pukkandan	46fff7105e	[youtube] Ignore invalid stretch ratio ... Closes #244	2021-04-14 15:22:17 +05:30
pukkandan	72e1fe969f	[downloader] Fix downloader selection for m3u8 ... Bug introduced by: 52a8a1e1b9 and a31953b0e6	2021-04-14 12:25:42 +05:30
Ashish	b5be6dd504	[TubiTv] Add TubiTvShowIE (#243) ... Authored by: Ashish0804	2021-04-14 12:22:28 +05:30
coletdjnz	8ea3f7b909	[youtube] Improve channel syncid extraction to support ytcfg (#241) ... Authored by: colethedj	2021-04-14 10:37:03 +05:30
pukkandan	921b76cab8	Ensure mergeall selects best format when multistreams are disabled	2021-04-13 10:53:25 +05:30
pukkandan	a31953b0e6	[downloader] Fix external downloader selection for m3u8 ... Closes #239	2021-04-12 22:34:11 +05:30
pukkandan	54670cf084	[version] update ... :ci skip all	2021-04-12 03:30:55 +05:30
pukkandan	b31fdeedfd	[documentation] Improvements	2021-04-12 02:36:06 +05:30
pukkandan	8fa43c73d8	Add option --convert-thumbnails ... Closes: https://github.com/yt-dlp/yt-dlp/issues/99 https://github.com/yt-dlp/yt-dlp/issues/102	2021-04-12 02:32:29 +05:30
pukkandan	56d868dbb7	Allow running some postprocessors before actual download	2021-04-12 02:12:46 +05:30
coletdjnz	f4f751af40	[youtube] Parse API parameters from initial webpage (#230) ... * Obtain innertube_context, api_key and x-goog-visitor-id from webpage * Generalize the header & Innertube_context extraction across YouTube extractors Related: 1b0a13f33c Authored by: colethedj	2021-04-12 01:53:04 +05:30
pukkandan	1988fab7e3	[youtube] Fix thumbnail URL ... Closes: https://github.com/yt-dlp/yt-dlp/issues/233 https://github.com/ytdl-org/youtube-dl/issues/28023	2021-04-11 06:06:13 +05:30
pukkandan	9de3ea3126	Pass any field to --exec using similar syntax to output template ... Related: https://github.com/ytdl-org/youtube-dl/issues/28642	2021-04-11 06:06:12 +05:30
pukkandan	e01d6aa435	Fix mergeall when requested formats are unavailable	2021-04-10 22:29:58 +05:30
pukkandan	f7ad71607d	Update to ytdl-commit-4fb25ff ... [maoritv] Add new extractor 4fb25ff5a3 Except: [vimeo] improve extraction 3ae9c0f410 [youtube:tab] Pass innertube context... 1b0a13f33c	2021-04-10 22:19:54 +05:30
pukkandan	68379de561	[downloaders] Fix API access ... Bug introduced by: 52a8a1e1b9	2021-04-10 21:15:32 +05:30
pukkandan	d9aa233295	Deprecate more options ... * `--all-formats` = `-f all` * `--include-ads` is not implemented	2021-04-10 20:58:36 +05:30
pukkandan	f37468c41f	Fix default of dynamic_mpd	2021-04-10 20:57:53 +05:30
pukkandan	52a8a1e1b9	Option to choose different downloader for different protocols ... * Renamed `--external-downloader-args` to `--downloader-args` * Added `native` as an option for the downloader * Use similar syntax to `--downloader-args` etc. Eg: `--downloader dash:native --downloader aria2c` * Deprecated `--hls-prefer-native` and `--hls-prefer-ffmpeg` since the same can now be done with `--downloader "m3u8:native"` and `m3u8:ffmpeg` respectively * Split `frag_urls` protocol into `m3u8_frag_urls` and `dash_frag_urls` * Standardize shortening of protocol names with `downloader.shorten_protocol_name`	2021-04-10 20:57:52 +05:30
pukkandan	d818eb7473	Improve argument parsing for -P, -o, -S ... * `-P "subtitle,thumbnail:PATH"` is now possible. Similarly for `-o` * `-S "fps,br" -S "res,codec"` is now interpreted as `-S res,codec,fps,br`. Previously, `-S fps,br` was ignored in this case.	2021-04-10 20:57:27 +05:30
pukkandan	f8d4ad9ab0	Format selector mergeall to download and merge all formats	2021-04-10 20:57:27 +05:30
pukkandan	3ffc7c89b0	[youtube] Fix _extract_alerts ... * Sometimes one warning is split between multiple runs * Also simplified code	2021-04-10 20:57:27 +05:30
Henrik Heimbuerger	f1823403b0	[nebula] Add extractor (watchnebula.com) (#122) ... Authored by: hheimbuerger	2021-04-09 16:57:38 +05:30
LE	384fb069ec	[NFHSNetwork] Add extractor (#217) ... Authored by: llacb47	2021-04-09 15:33:10 +05:30
bopol	a4ddaf231e	[nitter] Fix extraction of reply tweets (#218) ... And update instance list Closes #215 Authored by: B0pol	2021-04-08 22:33:36 +05:30
pukkandan	7e60c06925	[bilibili] Fix uploader ... Related: https://github.com/yt-dlp/yt-dlp/issues/222	2021-04-08 13:22:04 +05:30
coletdjnz	d92f5d5a90	[youtube] Extract comments' approximate timestamp (#221) ... Authored by: colethedj	2021-04-07 17:09:06 +05:30
colethedj	9e62f283ff	[utils] Add datetime_from_str to parse relative time (#221) ... and `datetime_add_months` to accurately add/subtract months Authored by: colethedj	2021-04-07 17:09:06 +05:30
bopol	c24ce07a84	[nitter] Fix thumbnails (#216) ... Authored by: B0pol	2021-04-05 16:53:33 +05:30
Ashish	de6758128e	[DiscoveryPlusIndia] Add DiscoveryPlusIndiaShowIE (#213) ... Co-authored-by: Ashish <ashish@pop-os.localdomain> Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>	2021-04-05 16:20:08 +05:30
pukkandan	73d4343e39	Fix some m3u8 not obeying --allow-unplayable-formats	2021-04-04 17:53:26 +05:30
pukkandan	57d104424f	[version] update ... :ci skip all	2021-04-04 03:57:29 +05:30
pukkandan	39ed931e53	Update to ytdl-commit-654b4f4 ... [youtube] prioritize information from YoutubeIE for playlist entries 654b4f4ff2	2021-04-04 03:49:04 +05:30
Matthew	b28f8d244a	[YouTube] Show premium state in availability (#209) ... Authored by colethedj	2021-04-03 14:20:58 +05:30
pukkandan	73cd218f5a	[documentation] Improve --parse-metadata documentation	2021-04-03 14:07:29 +05:30
pukkandan	84601bb72b	Ability to set a specific field in the file's metadata ... Eg: `--parse-metadata "description:(?s)(?P<meta_comment>.+)"` sets the "comment" field using `description`	2021-04-03 14:07:28 +05:30
pukkandan	54df8fc5b2	[ViewSource] Add extractor to handle view-source:	2021-04-03 14:07:27 +05:30
The Hatsune Daishi	5d39972ed0	[mildom] Update extractor to comply with current proxy (#212) ... Authored by nao20010128nao	2021-04-03 13:43:49 +05:30
pukkandan	0481374e1d	[DiscoveryPlus] Add discoveryplus.in (#203) ... Closes #201	2021-04-03 13:18:40 +05:30
pukkandan	eff635394a	Ability to select nth best format ... Eg: -f `bv*.2` * Also cleaned up the related format selection code	2021-04-02 22:16:52 +05:30
pukkandan	df0c81513e	[generic] Detect Invidious' link element (Closes #195)	2021-04-01 17:13:35 +05:30
pukkandan	3f6a90eb63	[ard:mediathek] Fix video id extraction (Closes #202)	2021-04-01 16:17:15 +05:30
pukkandan	b050d210df	Fix some typos and linter	2021-04-01 14:16:10 +05:30
pukkandan	f4e4be19f0	[sponskrub] Run before embedding thumbnail ... Workaround for https://github.com/faissaloo/SponSkrub/issues/29 Closes https://github.com/yt-dlp/yt-dlp/issues/204	2021-04-01 14:13:24 +05:30
pukkandan	cce889b900	Update to ytdl v2021-04-01 ... 14f29f087e Closes #205	2021-04-01 13:59:22 +05:30
nixxo	a6ae61a4c2	[la7] Add podcasts and podcast playlists (#198) ... Authored by: nixxo	2021-03-28 17:06:59 +05:30
pukkandan	b23b9eefd9	[version] update	2021-03-25 04:44:22 +05:30
pukkandan	a2f0b0c672	Release 2021.03.24.1	2021-03-25 04:33:34 +05:30
pukkandan	b704fc1a68	Revert commit 8562218 ... [ard] improve clip id extraction 8562218350 This was merged incorrectly	2021-03-25 04:31:32 +05:30
pukkandan	a3affbe6a0	Release 2021.03.24	2021-03-25 04:18:37 +05:30
pukkandan	1418a0437f	Update to ytdl-commit-8562218 ... [ard] improve clip id extraction 8562218350	2021-03-25 04:09:21 +05:30
pukkandan	143db31d48	Parse metadata from multiple fields ... Closes #196	2021-03-25 03:32:15 +05:30
pukkandan	3700c7ef10	[linuxacadamy] Fix login	2021-03-24 04:06:26 +05:30
pukkandan	498f560638	Ability to load playlist infojson ... * If `--no-clean-infojson` is given, the video ids are saved/loaded from in the infojson along with their playlist index * If a video entry that was not saved is requested, we fallback to using `webpage_url` to re-extract the entries Related: https://github.com/yt-dlp/yt-dlp/issues/190#issuecomment-804921024	2021-03-24 01:57:50 +05:30
pukkandan	394dcd4486	Write current epoch to infojson when using --no-clean-infojson ... Closes #191	2021-03-24 00:34:33 +05:30
pukkandan	83b20a970d	[youtube_live_chat] fix bug when trying to set cookies ... Closes #194	2021-03-23 17:53:36 +05:30
pukkandan	e1feb88fdf	[niconico] Fix for when logged in ... Related: https://github.com/yt-dlp/yt-dlp/issues/171#issuecomment-803692716 Co-authored by: CXwudi, xtkoba	2021-03-23 14:03:07 +05:30
pukkandan	389b9dbbcc	[version] update	2021-03-22 03:03:06 +05:30
pukkandan	421a459573	Update to ytdl-commit-7e79ba7 ... 7e79ba7dd6 [vimeo:album] Fix extraction for albums with number of videos multiple to page size	2021-03-22 02:58:41 +05:30
Matthew	c224251aad	[youtube] Show if video is private, unlisted etc in new field availability (#188) ... Closes: #185, https://github.com/ytdl-org/youtube-dl/issues/25631 Authored by: colethedj, pukkandan	2021-03-22 02:58:41 +05:30
pukkandan	037cc66ec8	[linuxacadamy] Improve regex ... TODO: We need to make a more robust standard regex for fetching js objects from html	2021-03-21 21:27:33 +05:30
Two Sheds" Jackson	9160a0c6a2	[nbc] Improve metadata extraction (#187) ... Authored by: 2ShedsJackson	2021-03-21 21:26:31 +05:30
2ShedsJackson	5c5fae6d2f	[amcnetworks] Fix extractor (#179) ... * Prefer use of manifest based on `releasePid` since the one based on `videoPid` may have Fairplay * Additional thumbnail images were added * Don't add `season_number` and `series` to `title` * `series` is now set to `None` rather than "_" when empty * fix bug with age limit Authored by: 2ShedsJackson	2021-03-20 16:11:11 +05:30
pukkandan	c1d3a4a8f0	[niconico] Add user extractor ... Co-authored by: animelover1984	2021-03-20 14:59:39 +05:30
pukkandan	adc74b3c6d	[bilibili] Add anthology support ... Closes: #118 Co-authored by: animelover1984	2021-03-20 14:56:42 +05:30
pukkandan	beb4b92a66	More consistent warning messages (#173) ... Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>	2021-03-20 09:34:52 +05:30
pukkandan	cd9b384cc3	Embed video URL metadata inside MP4 (#173) ... `mp4` has `comment` and `synopsis`; the synopsis is expected to have the long description So we save the `webpage_url` to `comment` and `description` to `synopsis` Related: https://github.com/ytdl-org/youtube-dl/issues/28478 Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>	2021-03-20 09:34:52 +05:30
pukkandan	4d971a16b8	Merge webm formats into mkv if thumbnails are to be embedded (#173) ... Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>	2021-03-20 09:34:52 +05:30
Damiano Amatruda	3561530776	Parse resolution in info dictionary (#173)	2021-03-20 09:34:52 +05:30
Damiano Amatruda	4690688658	Use headers and cookies when downloading subtitles (#173)	2021-03-20 09:34:52 +05:30
pukkandan	fe845284c4	[aria2c] Support retry/abort unavailable fragments (#173) ... Co-authored by: Damiano Amatruda <damiano.amatruda@outlook.com>	2021-03-20 09:33:33 +05:30
pukkandan	2b3bf01c90	[aria2c] Better default arguments	2021-03-20 09:31:53 +05:30
pukkandan	23c1a66730	Make sure post_hook gets the final filename	2021-03-20 09:31:53 +05:30
pukkandan	dd18a58cb1	[documentation] Add SplitChapters to --ppa	2021-03-20 09:31:53 +05:30
pukkandan	a94bfd6cfe	[splitchapters] Fix for older ffmpeg ... Older versions of ffmpeg doesn't allow `-to` as an input option Closes #180	2021-03-20 09:31:53 +05:30
pukkandan	a515a78dd3	fix some typos and linter	2021-03-18 22:19:31 +05:30
pukkandan	e167860ce7	[documentation] Add deprecated options and aliases in readme	2021-03-18 22:07:50 +05:30
pukkandan	75d43ca080	Option to keep private keys in the infojson ... Options: --clean-infojson, --no-clean-infojson Related: https://github.com/yt-dlp/yt-dlp/issues/42#issuecomment-800778391	2021-03-18 21:00:45 +05:30
pukkandan	5226731e2d	Recursively remove private keys from infojson ... Related: https://github.com/yt-dlp/yt-dlp/issues/42	2021-03-18 21:00:45 +05:30
pukkandan	dcf64d43e0	[movefiles] Fix bugs and make more robust	2021-03-18 20:54:53 +05:30
pukkandan	e3c076970e	[youtube] bugfix for channel playlist extraction ... Bug introduced in cd7c66cf01	2021-03-17 17:35:02 +05:30
pukkandan	7978e172f3	[niconico] Partial fix ... TODO: Smile formats don't work Extraction code that no longer works needs to be removed Adapted from: b5eff52dd9 by animelover1984 Related: https://github.com/yt-dlp/yt-dlp/issues/171 https://github.com/animelover1984/youtube-dl/issues/29 https://github.com/ytdl-org/youtube-dl/issues/28470	2021-03-17 15:38:24 +05:30
nixxo	605d299f83	[stitcher] Merge from youtube-dl (#175) ... This cherry-picks the commits: a563c97c5c (diff-cc37718b18689c1c0588c4c74518853ef43ab020bbd674f3c04d4eae037798d2) 8522bcd97c (diff-cc37718b18689c1c0588c4c74518853ef43ab020bbd674f3c04d4eae037798d2) Authored by: nixxo	2021-03-16 15:32:10 +05:30
nixxo	18c1f04362	[rcs] Improved extraction (See desc) (#170) ... * improved `video_data` extraction * added an extra fallback value for `description` * improved regex in `RCSVariousIE` Authored by: nixxo	2021-03-16 00:26:29 +05:30
pukkandan	e4beae703d	[formatSort] Fix quality being ignored ... Closes #172	2021-03-15 23:55:53 +05:30
pukkandan	d034ab669c	[sponskrub] Pass proxy to sponskrub ... Needs atleast sponskrub version: faissaloo/sponskrub 3.7.0 OR yt-dlp/sponskrub 2021.03.15	2021-03-15 06:27:21 +05:30
pukkandan	5aeefbd633	[version] update ... :ci skip all	2021-03-15 06:03:59 +05:30
pukkandan	597c18665e	Release 2021.03.15	2021-03-15 05:54:39 +05:30
pukkandan	10db0d2f57	Update to ytdl-commit-3be0980 ... 3be098010f	2021-03-15 04:52:06 +05:30
pukkandan	7275535116	Split video by chapters (#158) ... * New options `--split-chapters` and `--no-split-chapters` * The output/path of the split files can be given using the key `chapter` * Additional keys `section_title`, `section_number`, `section_start`, `section_end` are available in the output template * Alias `--split-tracks` for parity with animelover/youtube-dl * `--sponskrub-cut` and `--split-chapter` cannot work together Closes: https://github.com/blackjack4494/yt-dlc/issues/277 https://github.com/ytdl-org/youtube-dl/issues/28438 https://github.com/ytdl-org/youtube-dl/issues/12907 https://github.com/ytdl-org/youtube-dl/issues/6480 https://github.com/ytdl-org/youtube-dl/pull/25005 Rewritten from the implementation by: femaref and Wattux https://github.com/Wattux/youtube-dl/tree/split-at-timestamps https://github.com/ytdl-org/youtube-dl/pull/25005 https://github.com/femaref/youtube-dl/tree/split-track	2021-03-15 04:32:13 +05:30
Matthew	a1c5d2ca64	[Youtube] Rewrite comment extraction (#167) ... Closes #121 TODO: * Add an option for the user to specify newest/popular and max number of comments * Refactor the download code and generalize with TabIE * Parse time_text to timestamp	2021-03-15 04:11:11 +05:30
pukkandan	ca87974543	[embedthumbnail] Set mtime correctly ... Related: https://github.com/yt-dlp/yt-dlp/issues/67	2021-03-14 21:56:04 +05:30
pukkandan	e92caff5d5	Refactor (See desc) ... * Create `FFmpegPostProcessor.real_run_ffmpeg` that can accept multiple input/output files along with switches for each * Rewrite `cli_configuration_args` and related functions * Create `YoutubeDL._ensure_dir_exists` - this was previously defined in multiple places	2021-03-14 20:02:55 +05:30
CHJ85	ea3a012d2a	[pluto.tv] Add extractor (#163) ... https://github.com/ytdl-org/youtube-dl/pull/27621 Authored by: kevinoconnor7	2021-03-14 16:02:16 +05:30
pukkandan	5b8917fb52	[zee5] Support zee5originals	2021-03-14 15:22:29 +05:30
nixxo	8eec0120a2	[rai] fix drm check (#168) ... Bug introduced by #150 Authored by: nixxo	2021-03-13 21:08:50 +05:30
shirt	4cf1e5d2f9	Native concurrent downloading of fragments (#166) ... * Option `--concurrent-fragments` (`-N`) to set the number of threads Related: #165 Known issues: * When receiving Ctrl+C, the process will exit only after finishing the currently downloading fragments * The download progress shows the speed of only one thread Authored by shirt-dev	2021-03-13 10:16:58 +05:30
pukkandan	0a473f2f0f	More improvements to HLS/DASH external downloader code ... * Fix error when there is no `protocol` in `info_dict` * Move HLS byte range detection to `Aria2cFD` so that the download will fall back to the native downloader instead of ffmpeg * Fix bug with getting no fragments in DASH * Convert `check_results` in `can_download` to a generator	2021-03-11 22:07:42 +05:30
nixxo	e4edeb6226	[wimtv] Add extractor (#161) ... Added support for VODs, live and embeds Authored by: nixxo	2021-03-11 13:28:51 +05:30
Ashish	d488e254d9	[Zee5] Add Show Extractor (#160) ... Co-authored-by: Ashish <ashish@pop-os.localdomain> Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>	2021-03-11 13:18:09 +05:30
shirt-dev	d7009caa03	Improve HLS/DASH external downloader code (#162) ... Authored by: shirt	2021-03-10 20:09:40 +05:30
pukkandan	54759df586	[zee5] Improve regex	2021-03-09 15:17:16 +05:30
nixxo	605b684c2d	[mtv] Add mtv.it and extract series metadata (#156) ... * New extractors: MTVItalia, MTVItaliaProgramma * Extract fields: series, season_number, episode_number Authored-by: nixxo	2021-03-08 19:10:27 +05:30
pukkandan	994443d24d	[version] update :ci skip all	2021-03-08 00:16:25 +05:30
teesid	1f52a09e2e	[vimeo] Fix videos with password ... https://github.com/ytdl-org/youtube-dl/pull/27992 Fixes: https://github.com/ytdl-org/youtube-dl/issues/28354 Authored by teesid	2021-03-07 23:47:53 +05:30
pukkandan	fc21af505c	Fix some videos downloading with m3u8 extension	2021-03-07 23:22:12 +05:30
pukkandan	015f3b3120	[bilibili] Change Accept header (Closes #145) ... This is a temporary fix. Ideally we should find a more reasonable accept string that just "*/*" Fixes: https://github.com/ytdl-org/youtube-dl/issues/28363 https://github.com/ytdl-org/youtube-dl/issues/28341 Thanks to animelover1984 for identifying the problem	2021-03-07 17:59:59 +05:30
nixxo	0852947fcc	[rai] Check for DRM (#150) ... Authored by: nixxo <nixxo@protonmail.com>	2021-03-07 13:01:59 +05:30
pukkandan	99594a11ce	Remove "fixup is ignored" warning when fixup wasn't passed by user ... Closes #151	2021-03-07 12:32:59 +05:30
pukkandan	2be71994c0	[youtube] Detect when Mixes end or wrap around	2021-03-07 11:04:57 +05:30
pukkandan	26fe8ffed0	[youtube] Fix community page continuation (Closes #152)	2021-03-07 11:04:55 +05:30
nixxo	feee67ae88	[gedi] Improvements from youtube-dl (#149) ... Authored-by: nixxo <c.nixxo@gmail.com>	2021-03-06 23:40:32 +05:30
Ashish	1caaf92d47	[MXPlayer] Rewrite extractor with show support (#141) ... Co-authored-by: Ashish <ashish@pop-os.localdomain> Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>	2021-03-06 01:11:02 +05:30
Matthew	d069eca7a3	[Youtube] Fix private feeds/playlists on multi-channel accounts (#143) ... Authored by: colethedj	2021-03-05 19:29:14 +05:30
Matthew	f3eaa8dd1c	[Youtube] Extract alerts from continuation (#144) ... Related: #143 Authored by: colethedj	2021-03-05 15:37:32 +05:30
pukkandan	9e631877f8	[downloader] Fix bug for ffmpeg/httpie ... Caused by: 7f7de7f94d	2021-03-05 04:22:37 +05:30
pukkandan	36147a63e3	[trovo] Pass origin header (Closes #139) ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/28346	2021-03-04 23:59:37 +05:30
pukkandan	57db6a87ef	[lbry] Support lbry:// url ... https://github.com/ytdl-org/youtube-dl/pull/28207 Fixes: https://github.com/ytdl-org/youtube-dl/issues/28084 Authored by: nixxo <nixxo@protonmail.com>	2021-03-04 23:45:28 +05:30
pukkandan	cd7c66cf01	[youtube] Fix history, trending and mix playlists (#136) ... Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com> Co-authored-by: Matthew <colethedj@protonmail.com>	2021-03-04 23:35:26 +05:30
shirt-dev	2c736b4f61	[cbs] Add support for ParamountPlus (#138) ... Related: https://github.com/ytdl-org/youtube-dl/issues/28342 Authored-by: shirtjs <2660574+shirtjs@users.noreply.github.com>	2021-03-04 20:20:07 +05:30
pukkandan	c4a508ab31	[update] Fix updater removing the executable bit on some UNIX distros ... Closes #133	2021-03-03 19:07:14 +05:30
pukkandan	7815e55572	[update] Fix current build hash for UNIX	2021-03-03 19:02:21 +05:30
pukkandan	162e6f0000	[version] update :ci skip all	2021-03-03 16:42:23 +05:30
pukkandan	a8278ababd	Release 2021.03.03.2	2021-03-03 16:34:14 +05:30
pukkandan	3721515bde	Update to ytdl-2021.03.03	2021-03-03 16:04:01 +05:30
Matthew	a5c5623470	[YouTube] Use new browse API for continuation page extraction. (#131) ... Known issues (these issues existed in previous API as well) * Mix playlists only give 1 page (25 vids) * Trending only gives 1 video * History gives 5 pages (200 vids) Co-authored-by: colethedj, pukkandan	2021-03-03 16:02:40 +05:30
pukkandan	c705177da2	[youtube] Throw error when --extractor-retries are exhausted (Closes #130)	2021-03-03 03:05:31 +05:30
pukkandan	d6e51845b7	Reduce default of --extractor-retries to 3 ... so that even those not using sleep won't get 429'd on youtube	2021-03-03 03:04:08 +05:30
Ashutosh Chaudhary	097b056c5a	[mxplayer] Add new extractor ... https://github.com/ytdl-org/youtube-dl/pull/27325 Authored by: codeasashu	2021-03-02 17:49:48 +05:30
Han Dai	f3b737ed19	[nick] fix extraction ... https://github.com/ytdl-org/youtube-dl/pull/27900 Authored by: DennyDai	2021-03-02 17:02:45 +05:30
pukkandan	ee1e05581e	[mtv] Fix extractor by reverting changes made in youtube-dlc ... youtube-dl has since fixed the extractor and the changes from the two sources are incompatible	2021-03-02 16:55:17 +05:30
pukkandan	ec5e77c558	Update to ytdl-2021.03.02	2021-03-02 13:56:07 +05:30
shirt-dev	b3b30a4bca	Fix HLS playlist downloading (#127) ... Co-authored-by: shirtjs <2660574+shirtjs@users.noreply.github.com>	2021-03-01 12:05:45 -05:00
pukkandan	5372545ddb	[version] update :ci skip	2021-03-01 05:46:00 +05:30
pukkandan	5ef7d9bdd8	Release 2021.03.01	2021-03-01 05:39:50 +05:30
pukkandan	62bff2c170	Add option --extractor-retries to retry on known extractor errors ... * Currently only used by youtube Fixes https://github.com/ytdl-org/youtube-dl/issues/28194 Possibly also fixes: https://github.com/ytdl-org/youtube-dl/issues/28289 (can not confirm since the issue isn't reliably reproducible)	2021-03-01 05:18:37 +05:30
pukkandan	f0884c8b3f	Cleanup some code (see desc) ... * `--get-comments` doesn't imply `--write-info-json` if `-J`, `-j` or `--print-json` are used * Don't pass `config_location` to `YoutubeDL` (it is unused) * [bilibiliaudio] Recognize the file as audio-only * Update gitignore * Fix typos	2021-02-28 20:56:32 +05:30
pukkandan	277d6ff5f2	Extract comments only when needed #95 (Closes #94)	2021-02-28 20:26:08 +05:30
pukkandan	1cf376f55a	Add option --sleep-requests to sleep b/w requests (Closes #106) ... * Also fix documentation of `sleep_interval_subtitles` Related issues: https://github.com/blackjack4494/yt-dlc/issues/158 https://github.com/blackjack4494/youtube-dlc/issues/195 https://github.com/ytdl-org/youtube-dl/pull/28270 https://github.com/ytdl-org/youtube-dl/pull/28144 https://github.com/ytdl-org/youtube-dl/issues/27767 https://github.com/ytdl-org/youtube-dl/issues/23638 https://github.com/ytdl-org/youtube-dl/issues/26287 https://github.com/ytdl-org/youtube-dl/issues/26319	2021-02-27 18:14:42 +05:30
pukkandan	7f7de7f94d	Allow specifying path in --external-downloader	2021-02-27 16:52:27 +05:30
pukkandan	86878b6cd9	[hrfensehen] Fix wrong import	2021-02-27 15:35:41 +05:30
pukkandan	b3d1242534	[youtube] Fix inconsistent webpage_url (closes #119)	2021-02-27 14:45:56 +05:30
pukkandan	9bd2020476	[hls] Enable --hls-use-mpegts by default when downloading live-streams ... * Also added option `--no-hls-use-mpegts` to disable this Related: #96	2021-02-26 21:52:16 +05:30
pukkandan	ed9b7e3dd3	Fix bug with m3u8 format extraction	2021-02-26 18:32:28 +05:30
shirt-dev	c552ae8838	Fix get_executable_path (#117) ... Authored-by: shirtjs <2660574+shirtjs@users.noreply.github.com>	2021-02-26 04:28:02 +05:30
Robin Dunn	31a5e037a7	[viki] Fix viki play pass authentication (#111) ... Authored by: RobinD42	2021-02-26 03:33:00 +05:30
pukkandan	14fdfea973	[youtube] Retry on incomplete ytInitialData ... Related: #116	2021-02-26 03:23:08 +05:30
pukkandan	0e0040519b	[embedthumbnail] Fix bug with deleting original thumbnail (Closes #113) ... :ci skip dl	2021-02-25 18:35:04 +05:30
pukkandan	bce8cbb089	[tennistv] Fix format sorting	2021-02-25 16:07:38 +05:30
pukkandan	aae273ded8	[version] update :ci skip dl	2021-02-25 02:44:10 +05:30
pukkandan	7c60c33efe	Update to ytdl-commit-4460329 ... 44603290e5 Except: gedi, tmz 7422a2194f 8cb4b71909 d81421af4b	2021-02-25 02:29:47 +05:30
pukkandan	0744a815b7	[documentation] Changes left behind from #85 and #107	2021-02-25 01:42:33 +05:30
Pccode66	7a5c1cfe93	Completely change project name to yt-dlp (#85) ... * All modules and binary names are changed * All documentation references changed * yt-dlp no longer loads youtube-dlc config files * All URLs changed to point to organization account Co-authored-by: Pccode66 Co-authored-by: pukkandan	2021-02-25 00:15:56 +05:30