Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

NodeBB

  1. Home
  2. Selfhosted
  3. TubeArchivist alternatives that store data in an archive friendly manner?

TubeArchivist alternatives that store data in an archive friendly manner?

Scheduled Pinned Locked Moved Selfhosted
selfhosted
12 Posts 8 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • douglasg14b@lemmy.worldD [email protected]

    I've been using Tube Archivist to archive my YouTube playlists, but I've hit a portability snag. It stores all metadata in its internal database and saves video files with non-readable filenames. This makes the archive unreadable without the software and its database, which defeats the point of long-term archival storage.

    Are there any tools that:

    • Archive playlists with human-readable filenames (or let you control the naming scheme)
    • Have an API for queuing archival jobs
    • Store metadata in portable formats (e.g., sidecar JSON or YAML)
    • Don’t require additional software to interpret the archive
    T This user is from outside of this forum
    T This user is from outside of this forum
    [email protected]
    wrote last edited by
    #2

    I changed over to PinchFlat instead for Tube Archivist for these reasons. It’s even easier to setup than TA. I have mine hooked up to store the files on an SMB share that JellyFin can read. https://github.com/kieraneglin/pinchflat

    X 1 Reply Last reply
    17
    • douglasg14b@lemmy.worldD [email protected]

      I've been using Tube Archivist to archive my YouTube playlists, but I've hit a portability snag. It stores all metadata in its internal database and saves video files with non-readable filenames. This makes the archive unreadable without the software and its database, which defeats the point of long-term archival storage.

      Are there any tools that:

      • Archive playlists with human-readable filenames (or let you control the naming scheme)
      • Have an API for queuing archival jobs
      • Store metadata in portable formats (e.g., sidecar JSON or YAML)
      • Don’t require additional software to interpret the archive
      J This user is from outside of this forum
      J This user is from outside of this forum
      [email protected]
      wrote last edited by [email protected]
      #3

      Sure it's not a proprietary binary DB, right? Probably just sqlite or something? Bet you can just dump it.

      But yeah, switch to something without those problems. There's lots of them out there.

      douglasg14b@lemmy.worldD 1 Reply Last reply
      4
      • douglasg14b@lemmy.worldD [email protected]

        I've been using Tube Archivist to archive my YouTube playlists, but I've hit a portability snag. It stores all metadata in its internal database and saves video files with non-readable filenames. This makes the archive unreadable without the software and its database, which defeats the point of long-term archival storage.

        Are there any tools that:

        • Archive playlists with human-readable filenames (or let you control the naming scheme)
        • Have an API for queuing archival jobs
        • Store metadata in portable formats (e.g., sidecar JSON or YAML)
        • Don’t require additional software to interpret the archive
        S This user is from outside of this forum
        S This user is from outside of this forum
        [email protected]
        wrote last edited by
        #4

        https://github.com/meeb/tubesync

        1 Reply Last reply
        5
        • douglasg14b@lemmy.worldD [email protected]

          I've been using Tube Archivist to archive my YouTube playlists, but I've hit a portability snag. It stores all metadata in its internal database and saves video files with non-readable filenames. This makes the archive unreadable without the software and its database, which defeats the point of long-term archival storage.

          Are there any tools that:

          • Archive playlists with human-readable filenames (or let you control the naming scheme)
          • Have an API for queuing archival jobs
          • Store metadata in portable formats (e.g., sidecar JSON or YAML)
          • Don’t require additional software to interpret the archive
          H This user is from outside of this forum
          H This user is from outside of this forum
          [email protected]
          wrote last edited by
          #5

          i just use yt-dlp with a config that stores all metadata. seems to work fine.. but its kinda hassle to find what you need among all downloaded stuff

          1 Reply Last reply
          3
          • T [email protected]

            I changed over to PinchFlat instead for Tube Archivist for these reasons. It’s even easier to setup than TA. I have mine hooked up to store the files on an SMB share that JellyFin can read. https://github.com/kieraneglin/pinchflat

            X This user is from outside of this forum
            X This user is from outside of this forum
            [email protected]
            wrote last edited by
            #6

            Were you able to migrate your existing tubearchivist videos and metadata? I would love to switch to pinchflat, but it wouldn't be feasible for me to redownload my entire library

            T 1 Reply Last reply
            0
            • X [email protected]

              Were you able to migrate your existing tubearchivist videos and metadata? I would love to switch to pinchflat, but it wouldn't be feasible for me to redownload my entire library

              T This user is from outside of this forum
              T This user is from outside of this forum
              [email protected]
              wrote last edited by
              #7

              No I had to start from scratch sort of. PinchFlat lets you choose a start date for downloading newer videos.

              I decided to age out of my old TA library and keep the ones I wanted. Not perfect but it was an okay trade off to get away from TA’s naming system

              X 1 Reply Last reply
              0
              • J [email protected]

                Sure it's not a proprietary binary DB, right? Probably just sqlite or something? Bet you can just dump it.

                But yeah, switch to something without those problems. There's lots of them out there.

                douglasg14b@lemmy.worldD This user is from outside of this forum
                douglasg14b@lemmy.worldD This user is from outside of this forum
                [email protected]
                wrote last edited by
                #8

                Oh it's definitely an easy to read DB. But that's still beyond the point IMHO.

                If you can't reconstruct the state of your files without 3rd party software to interpret them, then they are not in an archive format.

                One should be able to browse their data using OS native tools on an offline device push comes to shove.

                1 Reply Last reply
                2
                • T [email protected]

                  No I had to start from scratch sort of. PinchFlat lets you choose a start date for downloading newer videos.

                  I decided to age out of my old TA library and keep the ones I wanted. Not perfect but it was an okay trade off to get away from TA’s naming system

                  X This user is from outside of this forum
                  X This user is from outside of this forum
                  [email protected]
                  wrote last edited by
                  #9

                  Damn that's what I was afraid of. Might just keep TA offline but available for already downloaded stuff and use pinchflat for everything new. Thanks for the response!

                  1 Reply Last reply
                  1
                  • douglasg14b@lemmy.worldD [email protected]

                    I've been using Tube Archivist to archive my YouTube playlists, but I've hit a portability snag. It stores all metadata in its internal database and saves video files with non-readable filenames. This makes the archive unreadable without the software and its database, which defeats the point of long-term archival storage.

                    Are there any tools that:

                    • Archive playlists with human-readable filenames (or let you control the naming scheme)
                    • Have an API for queuing archival jobs
                    • Store metadata in portable formats (e.g., sidecar JSON or YAML)
                    • Don’t require additional software to interpret the archive
                    M This user is from outside of this forum
                    M This user is from outside of this forum
                    [email protected]
                    wrote last edited by
                    #10

                    yt-dlp can archive entire playlists and set names to be based on combinations of channel, date and URL. Probably could get an ai to give you a command that downloads a playlist in your format with your naming scheme then uses wget to get a page archive of the same name or extract said metadata from the page.

                    douglasg14b@lemmy.worldD 1 Reply Last reply
                    0
                    • M [email protected]

                      yt-dlp can archive entire playlists and set names to be based on combinations of channel, date and URL. Probably could get an ai to give you a command that downloads a playlist in your format with your naming scheme then uses wget to get a page archive of the same name or extract said metadata from the page.

                      douglasg14b@lemmy.worldD This user is from outside of this forum
                      douglasg14b@lemmy.worldD This user is from outside of this forum
                      [email protected]
                      wrote last edited by
                      #11

                      The hard part is in the scripting, the retries, the back off, automation, queuing and queue management...etc

                      At that point I'm implementing my own bootleg TubeArchivist 😅

                      1 Reply Last reply
                      0
                      • douglasg14b@lemmy.worldD [email protected]

                        I've been using Tube Archivist to archive my YouTube playlists, but I've hit a portability snag. It stores all metadata in its internal database and saves video files with non-readable filenames. This makes the archive unreadable without the software and its database, which defeats the point of long-term archival storage.

                        Are there any tools that:

                        • Archive playlists with human-readable filenames (or let you control the naming scheme)
                        • Have an API for queuing archival jobs
                        • Store metadata in portable formats (e.g., sidecar JSON or YAML)
                        • Don’t require additional software to interpret the archive
                        pory@lemmy.worldP This user is from outside of this forum
                        pory@lemmy.worldP This user is from outside of this forum
                        [email protected]
                        wrote last edited by
                        #12

                        I settled on Tubesync. Pinchflat mysteriously stopped downloading new vids from a playlist I had it monitor. Surely I could have fixed it by checking logs or whatever but Tubesync has the exact same feature list and no downsides, so I just killed my pinchflat container and spun up tubesync.

                        1 Reply Last reply
                        0
                        Reply
                        • Reply as topic
                        Log in to reply
                        • Oldest to Newest
                        • Newest to Oldest
                        • Most Votes


                        • Login

                        • Login or register to search.
                        Powered by NodeBB Contributors
                        • First post
                          Last post
                        0
                        • Categories
                        • Recent
                        • Tags
                        • Popular
                        • World
                        • Users
                        • Groups