Commit Graph

3183 Commits

Author SHA1 Message Date
cb9b84f940 Move 'extract_text()' to 'extractors_utils.cr' 2021-10-18 16:14:37 +02:00
33d9be0ffb Move 'extractors.cr' to 'yt_backend' folder 2021-10-18 16:12:49 +02:00
2571e420f3 Move 'add_yt_headers()' to 'connection_pool.cr' 2021-10-18 16:12:18 +02:00
e17c8b1f4d Move 'extract_videos' and 'extract_selected_tab' too 2021-10-18 16:12:18 +02:00
8805ee7c8c Add fetch_continuation_token back (required by #2215) 2021-10-18 16:12:18 +02:00
7df2fd0bc8 Add 'require' statement to 'invidious.cr' 2021-10-18 16:12:17 +02:00
f7f0910953 Remove fetch_continuation_token(): dead code 2021-10-18 16:12:17 +02:00
d300797e22 Move the YoutubeConnectionPool code to its own file 2021-10-18 16:12:17 +02:00
56dbe15943 Move proxy & YoutubeAPI code to the yt_backend folder 2021-10-18 16:12:17 +02:00
5f65e92500 Merge pull request #2508 from syeopite/lazy-load-images
Lazy load (some) images
2021-10-17 18:25:59 +00:00
21b96a3159 Merge pull request #2506 from syeopite/handle-empty-playlist-tabs
Handle YT tabs without content
2021-10-15 22:13:25 +00:00
888c7e2c29 Merge pull request #2491 from syeopite/extract-image-routes
Extract image routes
2021-10-15 22:13:10 +00:00
22e8f7e287 Fix #2510 2021-10-14 21:00:14 +02:00
0ad2793b68 Link to invidious.io/donate/ in the footer 2021-10-14 20:20:25 +02:00
585e4617e8 Lazy load (some) images 2021-10-14 08:18:44 -07:00
4d44b2c3a4 Handle YT tabs without any content 2021-10-13 11:38:20 -07:00
b49b5fbda9 Support empty categories 2021-10-13 11:35:31 -07:00
17e6093abb Merge pull request #2497 from Yetangitu/videorendererparser_parse_missing_title
Handle missing title fields in VideoRendererParser.parse (fixes #2495)
2021-10-12 19:04:51 +00:00
3dc980e800 Fix for #2488 - parse contents of search results of type=Category (#2496)
* Fix for #2488 - parse contents of search results of type=Category (returned on first page for universal (type=all) queries instead of returning an error.

* Moved content array walker to Category#to_json

As requested by reviewer this change moves the content array walker from the API endpoint to the Category class.

* Update src/invidious/helpers/serialized_yt_data.cr

Co-authored-by: syeopite <70992037+syeopite@users.noreply.github.com>
2021-10-12 18:17:45 +00:00
c44c1003af Handle missing title fields in VideoRendererParser.parse 2021-10-12 14:56:15 +00:00
678b10dbcf Lookback 50 videos 2021-10-11 23:52:57 +02:00
a1d6411f1f propagate video_id field on getting playlists 2021-10-11 23:51:07 +02:00
c4c8a10507 rename from continuation to video_id on get_playlist_videos 2021-10-11 23:49:08 +02:00
ee94ccdeb0 update to new YoutubeAPI 2021-10-11 23:49:08 +02:00
e3df9f9ead use dig for getting the video index 2021-10-11 23:49:08 +02:00
62dc629337 linting 2021-10-11 23:49:08 +02:00
dccdf38ce7 increase the max videos in a playlist 2021-10-11 23:49:07 +02:00
84124b837d use v1/next instead of searching for the continuation index 2021-10-11 23:49:07 +02:00
6176da3cbb linting 2021-10-11 23:46:23 +02:00
24bc3e2704 no need to normalize the offset 2021-10-11 23:45:22 +02:00
0a9e19646a pass the api/v1/playlists with videos before the offset 2021-10-11 23:43:41 +02:00
65e45c4079 linting 2021-10-11 23:30:49 +02:00
440105976f fix cases when high offset video from playlist has no offset in url 2021-10-11 23:30:49 +02:00
7eba7fbcc7 add index to playlist item 2021-10-11 23:30:49 +02:00
d9bfb3d305 playlist starts at the offset 2021-10-11 23:30:49 +02:00
4246c7a523 Extract image routes 2021-10-11 13:22:11 -07:00
57ed047025 Add mising 'require' statement to 'invidious.cr' 2021-10-11 18:33:36 +02:00
bda3a26423 Move server structure to a separate file 2021-10-11 18:33:36 +02:00
080d9a8dc7 move theme converter function to a separate file 2021-10-11 18:33:36 +02:00
984a4acc7b Move user preferences structure to a separate file 2021-10-11 18:33:36 +02:00
b10f37bea9 Use kemal in production mode (#2455) 2021-10-11 14:42:22 +02:00
0947c26612 Fix URL-encoding in href strings (#2460)
* hrefs: replace HTML.escape w/ URI.encode_www_form

* Fix search_query_encoded
2021-10-11 05:18:20 -07:00
c6f088d6ca Reduce refresh delay, increase backoff start duration 2021-10-08 18:39:02 +02:00
21e29411af Fix extractor bugs (#2454)
* Add debug/trace logging to extract_items
* Handle invalid timestamps for livestreams extraction
* Make use of author_fallback in playlist extractor
* Don't use extract_text for video length extraction

The extract_text function attempts to extract from both the simpleText and
the runs route. This is typically what we'd want for text extraction as
it could appear in both locations. However, while this still holds true,
the thumbnailOverlayTimeStatusRenderer writes a numerical length (when
present on the video) to the simpleText route and uses runs for a
text overlay like "LIVE" or "PREMIERE".

Therefore, when a video has a text overlay instead of a numerical one,
Invidious still passes it onto decode_length_seconds, which obviously
raises since it cannot be converted into integers.

In the future, if more routes requires one text route over the other, we
should go ahead and add an argument to extract_text itself. Though for
now, this is sufficient.

* Handle unsupported "special" categories
2021-10-07 23:39:21 +02:00
adc12addfa Add config option to display source code URL in footer (#2450) 2021-10-07 13:53:12 +02:00
d806310665 Revert "Fix typo (#2456)" (#2457)
This reverts commit 4982bff74d.
2021-10-04 19:51:57 +02:00
4982bff74d Fix typo (#2456) 2021-10-04 17:47:57 +00:00
81b12b8001 Add support to make invidious API-only via flag (#2363) 2021-10-02 20:04:02 +00:00
3e781b7d13 Merge pull request #2443 from iv-org/syeopite-patch-1
Use make_client when querying instance api
2021-10-02 20:00:37 +00:00
9c44e41a4c Merge pull request #2228 from syeopite/extract-items-overhaul
Overhaul extract_item(s) functions and add infrastructure for parsing YouTube categories
2021-10-02 20:00:16 +00:00