mir/NewPipeExtractor
2
0
Fork 0
mirror of https://github.com/TeamNewPipe/NewPipeExtractor synced 2025-08-30 22:05:18 +00:00
Code Issues Releases Wiki Activity
2,706 Commits 12 Branches 79 Tags
746b36e80d112444dcdfa0fdfbd93d15e7a8dcae
Commit Graph

2706 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
litetex
746b36e80d Improve tests 
* Dedup using parameterized tests
* Make ``now`` controllable
 2025-01-23 21:48:29 +01:00
Isira Seneviratne
ae07ba3c72 Remove unused method in TimeAgoParser 2025-01-23 20:56:16 +01:00
Stypox
a7154c3087 Release v0.24.4 v0.24.4 2025-01-21 23:14:31 +01:00
Stypox
4c720328ae Merge pull request #1262 from Theta-Dev/fix/ios-client-vdata 
[YouTube] update iOS client, add visitor data to requests
 2025-01-21 23:12:58 +01:00
ThetaDev
936bf2d71b Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/YoutubeParsingHelper.java 
Co-authored-by: Stypox <stypox@pm.me>
 2025-01-21 23:09:40 +01:00
Stypox
5b31ff20e5 iPhone 15 Pro Max instead of 16 in comments 2025-01-21 23:09:00 +01:00
ThetaDev
45645b043b update comment 2025-01-21 13:12:51 +01:00
ThetaDev
65d888f4cf move ProtoBuilder, add tests, fix incompatible rand call 2025-01-21 03:05:54 +01:00
ThetaDev
40059ed687 fix: update iOS client, add visitor data to YouTube requests 2025-01-19 19:59:10 +01:00
TobiGr
8e92227b2e Fix JDoc v0.24.3 2024-11-24 17:15:36 +01:00
Stypox
eebcc46255 Release v0.24.3 2024-11-24 17:07:47 +01:00
Stypox
9fb03f6c87 Merge pull request #1192 from TeamNewPipe/user-agent 
[tests] Update user agent
 2024-11-18 17:13:55 +01:00
TobiGr
e4a1a6ecd8 Fix tests 2024-11-17 21:38:47 +01:00
TobiGr
727e791602 [YouTube] Update mocks 2024-11-17 21:38:46 +01:00
TobiGr
d635d4db2a Make RecordingDownloader more resillient against ReCaptchaExceptions 
Implement a max number of requests per minute to prevent hitting reate limits and triggering ReCaptchaExceptions. This slows down the RecordingDownloader significantly and can be adjusted if needed. A request ist retried once when facing a ReCaptchaException.
 2024-11-17 21:38:46 +01:00
Stypox
ea1a1d1375 Merge pull request #1242 from TeamNewPipe/revert-1205-feature-branch 
Revert "Refactored Identifiers"
 2024-11-16 14:01:10 +01:00
Stypox
c00d0a7028 Revert "Refactored Identifiers (#1205)" 
This reverts commit 0de224124b.
 2024-11-16 14:00:38 +01:00
Stypox
d3d5f2b3f0 Merge pull request #1240 from AudricV/yt_fix-playlists-items-extraction 
[YouTube] Add support for new playlist items data structure
 2024-11-14 16:37:35 +01:00
congyuluo
0de224124b Refactored Identifiers (#1205) 
Extractor.pageFetched -> Extractor.isPageFetched
Stream.equalStats(Stream) is renamed to Stream.areStatsEqual(Stream)
Stream.getBitrate() is renamed to Stream.getBitRate()
 2024-11-13 10:01:20 +01:00
AudricV
183563cc9e [YouTube] Add support for playlists lockupViewModels 
This new data type, A/B tested or rolled out at the time the changes
are commited, is present on multiple surfaces.
 2024-11-10 21:44:06 +01:00
AudricV
f52d2269fc [YouTube] Move channel verified status check from badges to a method 
This method will be used in more places such as the new playlist item
data.

Support for a new icon used in artist channels has been also added.
 2024-11-10 20:18:04 +01:00
TobiGr
667c867ad8 Update user agent to Firefox ESR 128 2024-11-10 17:27:22 +01:00
Tobi
169098432b Merge pull request #1239 from AudricV/yt_fix-shorts-thumbnails-extraction 
[YouTube] Fix Shorts' thumbnails extraction in their channel tab
 2024-11-06 09:42:13 +01:00
AudricV
06b2c8e2aa [YouTube] Fix Shorts' thumbnails extraction in their channel tab 
Wrong methods were used to access and extract the thumbnails' data.
This has been fixed with this commit.
 2024-11-06 09:31:42 +01:00
Tobi
c343e31ed2 Merge pull request #1236 from Thompson3142/fix_scrubbing_seekbar_preview_crash 
Add documentation for faulty framesets
 2024-10-27 14:42:06 +01:00
TobiGr
1f26c12098 Use JDoc and inherit doc 2024-10-27 09:45:15 +01:00
Tobi
6af22e3e45 Merge pull request #1237 from AudricV/yt_more-audio-track-types-support 
[YouTube] Add support for automatic dubbed and secondary audio tracks
 2024-10-27 09:19:01 +01:00
AudricV
8a3350f79d [YouTube] Add support for automatic dubbed and secondary tracks 2024-10-26 20:32:39 +02:00
Thompson3142
542867ff4d Add documentation for faulty framesets 2024-10-24 19:36:35 +02:00
Tobi
abba78cf9d Merge pull request #1235 from TeamNewPipe/dependabot/gradle/org.junit-junit-bom-5.11.3 
Bump org.junit:junit-bom from 5.11.2 to 5.11.3
 2024-10-22 20:53:10 +02:00
dependabot[bot]
534bbc90cf Bump org.junit:junit-bom from 5.11.2 to 5.11.3 
Bumps [org.junit:junit-bom](https://github.com/junit-team/junit5) from 5.11.2 to 5.11.3.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.11.2...r5.11.3)

---
updated-dependencies:
- dependency-name: org.junit:junit-bom
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-10-22 09:39:48 +00:00
Tobi
f169885dbc Merge pull request #1219 from floriegl/fix-case-sensitive-jitpack-coordinates 
Fix for JitPack case sensitive coordinates in README
 2024-10-10 15:28:04 +02:00
Tobi
18c9f1fd38 Merge pull request #1233 from TeamNewPipe/dependabot/gradle/org.junit-junit-bom-5.11.2 
Bump org.junit:junit-bom from 5.11.0 to 5.11.2
 2024-10-05 20:22:02 +02:00
dependabot[bot]
fb81eaab82 Bump org.junit:junit-bom from 5.11.0 to 5.11.2 
Bumps [org.junit:junit-bom](https://github.com/junit-team/junit5) from 5.11.0 to 5.11.2.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.11.0...r5.11.2)

---
updated-dependencies:
- dependency-name: org.junit:junit-bom
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-10-05 18:17:38 +00:00
Tobi
5431069588 Merge pull request #1231 from AudricV/yt_fix-n-param-decode-function-extraction 
[YouTube] Fix extraction of n param deobfuscation function name
 2024-10-05 20:16:15 +02:00
Tobi
743a4000b8 Merge pull request #1207 from TeamNewPipe/fix/peertube-certain-domains 
[PeerTube] Fix parsing ID for instances whose domain ends with a or c
 2024-10-05 19:20:42 +02:00
AudricV
69ff271be1 [YouTube] Fix extraction of n param deobfuscation function name 
This commit adds two new regular expressions to parse the n parameter function.

It also improves existing regular expressions by using the constant representing
multiple characters instead of adding the one or multiple characters
token manually in each regex for everything and not only function names.
 2024-09-29 16:01:10 +02:00
Audric V.
eb30316a36 Merge pull request #1222 from AudricV/yt_fix-videos-channel-tab-linkhandler-serialization 
[YouTube] Fix serialization of Videos channel tab when it is already fetched
 2024-09-29 15:58:43 +02:00
AudricV
42c1afaf87 [YouTube] Fix serialization of Videos channel tab when already fetched 
Also remove usage of Optional as fields as it is not a good practice. This
simplifies in some places channel info extraction code.
 2024-09-29 15:35:21 +02:00
Audric V.
596bce294d Merge pull request #1221 from AudricV/yt_support-new-shorts-ui-data 
[YouTube] Fix extraction of Shorts in channels and remove visitor data usage
 2024-09-29 14:54:07 +02:00
AudricV
f9ffdd91d5 [YouTube] Update YoutubeChannelTabExtractorTest.Shorts test class mocks 2024-09-08 17:51:08 +02:00
AudricV
34f28fc1f0 [YouTube] Remove visitorData usage for shorts continuations 
It isn't required anymore and not used by extractor anymore since commit
5a6da5f43e, as the wrong page ID is used as a
visitor data (the VerifiedStatus value as a string).
 2024-09-08 17:41:23 +02:00
AudricV
f926fbcf35 [YouTube] Add support for shortsLockupViewModels 
This new UI data type is replacing the reelItemRenderer one.
 2024-09-08 17:21:40 +02:00
floriegl
36cc17c789 Update dependency coordinates due to case sensitivity in JitPack 2024-09-04 15:33:05 +02:00
TobiGr
6e3a4a6d9d [SoundCloud] Fix test: title changed 2024-08-15 12:22:37 +02:00
Tobi
70d6a06bf2 Merge pull request #1211 from TeamNewPipe/dependabot/gradle/org.junit-junit-bom-5.11.0 
Bump org.junit:junit-bom from 5.10.3 to 5.11.0
 2024-08-15 12:12:40 +02:00
dependabot[bot]
1278517492 Bump org.junit:junit-bom from 5.10.3 to 5.11.0 
Bumps [org.junit:junit-bom](https://github.com/junit-team/junit5) from 5.10.3 to 5.11.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.10.3...r5.11.0)

---
updated-dependencies:
- dependency-name: org.junit:junit-bom
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-08-15 09:10:12 +00:00
TobiGr
bcacfc53c5 [PeerTube] Fix parsing id for instances whose domain ends with a or c 
The pattern to detect the channel ID was faulty and e.g. the ID detected for "https://kolektiva.media/video-channels/documentary_channel" was "a/video-channels" which is wrong.  A new pattern is added to distinguish between URLs and potential IDs because IDs must not start with a "/" while IDs inside an URL must.

Fixes TeamNewPipe/NewPipe#11369
 2024-08-02 18:19:45 +02:00
TobiGr
6963385176 Fix issue template dir name 2024-08-02 12:50:30 +02:00
opusforlife2
5f1ba8cf7d Add issue templates (#1204) 
* Create bug report template

* Create feature request template

* Create config.yml

---------

Co-authored-by: TobiGr <tobigr@users.noreply.github.com>
 2024-08-02 12:44:11 +02:00