61 commits

Author	SHA1	Message	Date
bashonly	2469119490	[core] Address gaps in allowed extensions (#10362) ... Adds some extensions missing in 5ce582448e Closes #10360, Closes #10365 Authored by: bashonly	2024-07-05 23:17:47 +00:00
bashonly	cc767e9490	[core] Fix --ignore-no-formats-error (#10345) ... Fixes regression in 5ce582448e Closes #10344 Authored by: Grub4K Co-authored-by: Simon Sawicki <contact@grub4k.xyz>	2024-07-03 16:46:01 +00:00
Simon Sawicki	5ce582448e	[core] Disallow unsafe extensions (CVE-2024-38519) ... Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-79w7-vh3h-8g4j Authored by: Grub4K	2024-07-02 00:58:40 +02:00
sepro	add96eb9f8	[cleanup] Add more ruff rules (#10149) ... Authored by: seproDev Reviewed-by: bashonly <88596187+bashonly@users.noreply.github.com> Reviewed-by: Simon Sawicki <contact@grub4k.xyz>	2024-06-12 01:09:58 +02:00
Simon Sawicki	5c019f6328	[misc] Cleanup (#9765) ... Closes #9763 Authored by: bashonly, seproDev, Grub4K Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com> Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>	2024-05-26 21:37:49 +00:00
coletdjnz	96a134dea6	[ie/youtube] Extract upload timestamp if available (#9856) ... Closes #4962, Closes #9829 Authored by: coletdjnz	2024-05-26 21:13:12 +00:00
Simon Sawicki	64766459e3	[core/windows] Improve shell quoting and tests (#9802) ... Authored by: Grub4K	2024-04-27 10:37:26 +02:00
Simon Sawicki	ff07792676	[core] Prevent RCE when using --exec with %q (CVE-2024-22423) ... The shell escape function now properly escapes `%`, `\\` and `\n`. `utils.Popen` as well as `%q` output template expansion have been patched accordingly. Prior to this fix using `--exec` together with `%q` when on Windows could cause remote code to execute. See https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-hjq6-52gw-2g7p for more details. Authored by: Grub4K	2024-04-09 18:36:13 +02:00
Simon Sawicki	32abfb00bd	[utils] traverse_obj: Convenience improvements (#9577) ... Add support for: - `http.cookies.Morsel` - Multi type filters (`{type, type}`) Authored by: Grub4K	2024-04-01 02:12:03 +02:00
pukkandan	c305a25c1b	[cleanup] Standardize import datetime as dt (#8978)	2024-04-01 05:32:15 +05:30
sepro	86e3b82261	[core] Fix filesize_approx calculation (#9560) ... Reverts 22e4dfacb6 Despite being documented as `Kbit/s`, the extractors/manifests were returning bitrates in SI units of kilobits/sec. Authored by: seproDev, pukkandan	2024-04-01 04:47:24 +05:30
Simon Sawicki	3699eeb67c	[utils] traverse_obj: Allow unbranching using all and any (#9571) ... Authored by: Grub4K	2024-03-30 19:54:43 +01:00
pukkandan	615a84447e	[cleanup] Misc (#8968) ... Authored by: pukkandan, bashonly, seproDev	2024-03-11 00:52:28 +05:30
pukkandan	45491a2a30	[utils] Improve repr of DateRange, match_filter_func	2024-03-11 00:51:39 +05:30
pukkandan	93240fc184	[cleanup] Fix misc bugs (#8968) ... Closes #8816 Authored by: bashonly, seproDev, pukkandan, Grub4k	2024-03-11 00:51:26 +05:30
pukkandan	47ab66db0f	[docs] Misc Cleanup (#8977) ... Closes #8355, #8944 Authored by: bashonly, Grub4k, Arthurszzz, seproDev, pukkandan Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com> Co-authored-by: bashonly <bashonly@protonmail.com> Co-authored-by: Arthurszzz <minecraftgamerarthur@gmail.com> Co-authored-by: Simon Sawicki <accounts@grub4k.xyz> Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com>	2024-03-11 00:48:47 +05:30
Simon Sawicki	ffbd4f2a02	[utils] traverse_obj: Support xml.etree.ElementTree.Element (#8911) ... Authored by: Grub4K	2024-01-05 21:26:17 +01:00
Simon Sawicki	f9fb3ce86e	[cleanup] Misc (#8598) ... Authored by: bashonly, pukkandan, seproDev, Grub4K Co-authored-by: bashonly <bashonly@protonmail.com> Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com> Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>	2023-12-30 22:27:36 +01:00
Simon Sawicki	65de7d204c	Update to ytdl-commit-be008e6 (#8836) ... - [utils] Make restricted filenames ignore some Unicode categories (by dirkf) - [ie/telewebion] Fix extraction (by Grub4K) - [ie/imgur] Overhaul extractor (by bashonly, Grub4K) - [ie/EpidemicSound] Add extractor (by Grub4K) Authored by: bashonly, dirkf, Grub4K Co-authored-by: bashonly <bashonly@protonmail.com>	2023-12-26 01:40:24 +01:00
coletdjnz	196eb0fe77	[networking] Strip whitespace around header values (#8802) ... Fixes https://github.com/yt-dlp/yt-dlp/issues/8729 Authored by: coletdjnz	2023-12-20 19:15:38 +13:00
Simon Sawicki	0b6f829b1d	[utils] traverse_obj: Move is_user_input into output template (#8673) ... Authored by: Grub4K	2023-12-06 21:46:45 +01:00
pukkandan	a174c453ee	Let read_stdin obey --quiet ... Closes #8668	2023-11-29 05:48:40 +05:30
coletdjnz	ccfd70f4c2	[rh:websockets] Migrate websockets to networking framework (#7720) ... * Adds a basic WebSocket framework * Introduces new minimum `websockets` version of 12.0 * Deprecates `WebSocketsWrapper` Fixes https://github.com/yt-dlp/yt-dlp/issues/8439 Authored by: coletdjnz	2023-11-20 08:04:04 +00:00
bashonly	f04b5bedad	[ie] Do not smuggle http_headers ... See: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-3ch3-jhc6-5r8x Authored by: coletdjnz	2023-11-14 22:04:25 +01:00
bashonly	84e26038d4	[utils] write_xattr: Use os.setxattr if available (#8205) ... Closes #8193 Authored by: bashonly, Grub4K Co-authored-by: Simon Sawicki <contact@grub4k.xyz>	2023-10-09 18:30:36 +00:00
Simon Sawicki	1c51c520f7	[fd/fragment] Improve progress calculation (#8241) ... This uses the download speed from all threads and also adds smoothing to speed and eta Authored by: Grub4K	2023-10-08 02:01:01 +02:00
Awal Garg	9d7ded6419	[utils] js_to_json: Fix Date constructor parsing (#8295) ... Authored by: awalgarg, Grub4K	2023-10-08 01:57:23 +02:00
Simon Sawicki	de015e9307	[core] Prevent RCE when using --exec with %q (CVE-2023-40581) ... The shell escape function is now using `""` instead of `\"`. `utils.Popen` has been patched to properly quote commands. Prior to this fix using `--exec` together with `%q` when on Windows could cause remote code to execute. See https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-42h4-v29r-42qg for reference. Authored by: Grub4K	2023-09-24 02:29:01 +02:00
bashonly	52414d64ca	[utils] js_to_json: Handle Array objects ... Authored by: Grub4K, std-move Co-authored-by: std-move <26625259+std-move@users.noreply.github.com> Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>	2023-09-21 16:51:57 -05:00
Simon Sawicki	836e06d246	[core] Fix support for upcoming Python 3.12 (#8130) ... This also adds the following test runners: - `3.12-dev` on `ubuntu-latest` - `3.12-dev` on `windows-latest` - `pypy-3.10` on `ubuntu-latest` Authored by: Grub4K	2023-09-17 12:56:50 +02:00
Simon Sawicki	f659e64394	[ie/bpb] Overhaul extractor (#8119) ... Authored by: Grub4K	2023-09-16 17:50:06 +02:00
pukkandan	3f7965105d	[utils] HTTPHeaderDict: Handle byte values	2023-07-30 03:18:10 +05:30
coletdjnz	4bf912282a	[networking] Remove dot segments during URL normalization (#7662) ... This implements RFC3986 5.2.4 remove_dot_segments during the URL normalization process. Closes #3355, #6526 Authored by: coletdjnz	2023-07-28 22:40:20 +00:00
coletdjnz	bbeacff7fc	[networking] Ignore invalid proxies in env (#7704) ... Authored by: coletdjnz	2023-07-27 20:26:02 +05:30
pukkandan	a250b24733	[compat] Ensure submodules are imported correctly ... Closes #7663	2023-07-22 18:10:35 +05:30
bashonly	af86873218	[utils] Improve parse_duration ... Authored by: bashonly	2023-07-20 08:40:31 -05:00
coletdjnz	3d2623a898	[compat, networking] Deprecate old functions (#2861) ... Authored by: coletdjnz, pukkandan	2023-07-15 16:18:35 +05:30
coletdjnz	227bf1a33b	[networking] Rewrite architecture (#2861) ... New networking interface consists of a `RequestDirector` that directs each `Request` to appropriate `RequestHandler` and returns the `Response` or raises `RequestError`. The handlers define adapters to transform its internal Request/Response/Errors to our interfaces. User-facing changes: - Fix issues with per request proxies on redirects for urllib - Support for `ALL_PROXY` environment variable for proxy setting - Support for `socks5h` proxy - Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093 - Raise error when using `https` proxy instead of silently converting it to `http` Authored by: coletdjnz	2023-07-15 16:18:35 +05:30
pukkandan	c365dba843	[networking] Add module (#2861) ... No actual changes - code is only moved around	2023-07-15 16:18:34 +05:30
pukkandan	1b392f905d	[utils] Add temporary shim for logging ... Related: #5680, #7517	2023-07-15 16:18:34 +05:30
Mahmoud Abdel-Fattah	2af4eeb772	[utils] clean_podcast_url: Handle more trackers (#7556) ... Authored by: mabdelfattah, bashonly Closes #7544	2023-07-11 06:30:38 +05:30
coletdjnz	f8b4bcc0a7	[core] Prevent Cookie leaks on HTTP redirect ... Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj Authored by: coletdjnz	2023-07-06 23:14:39 +05:30
pukkandan	337734d4a8	[cleanup] Misc	2023-07-06 21:39:55 +05:30
pukkandan	91302ed349	[utils] clean_podcast_url: Handle protocol in redirect URL ... Closes #7430	2023-06-26 16:19:49 +05:30
pukkandan	e59e20744e	Bugfix for b4e0d75848	2023-06-22 23:45:53 +05:30
pukkandan	812cdfa06c	[cleanup] Misc	2023-06-22 13:31:07 +05:30
pukkandan	b4e0d75848	Improve --download-sections ... * Support negative time-ranges * Add `*from-url` to obey time-ranges in URL Closes #7248	2023-06-22 13:03:07 +05:30
pukkandan	ad54c9130e	[cleanup] Misc ... Closes #6288, Closes #7197, Closes #7265, Closes #7353, Closes #5773 Authored by: mikf, freezboltz, pukkandan	2023-06-21 09:21:20 +05:30
Nicolai Dagestad	db3ad8a676	Add option --netrc-cmd (#6682) ... Authored by: NDagestad, pukkandan Closes #1706	2023-06-21 08:37:42 +05:30
pukkandan	ebe1b4e34f	[outtmpl] Fix some minor bugs ... Closes #7164	2023-06-21 06:10:39 +05:30