YouTube network request Strange Behaviour









up vote
-1
down vote

favorite












I'm scraping YouTube videos for automatic captions and storing them locally. I use window.performance.getEntries() to find the link to the subtitles after enabling subtitles. But when I tried to open some of the links the day after I retrieved them I got a 404 error.



Here is a now-defunct link to a YouTube video's captions that I retrieved yesterday: https://www.youtube.com/api/timedtext?sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&hl=en&signature=B50CC4269D15CD954D6946B6342194EDF9F6D01F.AF819BEDE91E0F31C8F02A04508E49FC02B4F504&xorp=True&v=FSyAehMdpyI&asr_langs=ja%2Cko%2Cen%2Cde%2Cpt%2Cru%2Cnl%2Cfr%2Cit%2Ces&xoaf=1&key=yttt1&caps=asr&expire=1541769833&lang=en&fmt=srv3



I scraped the subtitles link from the same video and it's now changed!



https://www.youtube.com/api/timedtext?xoaf=1&expire=1541822131&signature=585C6AB59561084DC1B7F963679FF2D916257EFA.5EBAF0C3037FD561A0636CA47CF95396773DB78B&hl=en&asr_langs=ja%2Cpt%2Cde%2Cko%2Cru%2Cen%2Cnl%2Ces%2Cfr%2Cit&sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&v=FSyAehMdpyI&caps=asr&key=yttt1&xorp=True&lang=en&fmt=srv3



Is there a permanent solution for storing these automatic captions?










share|improve this question

























    up vote
    -1
    down vote

    favorite












    I'm scraping YouTube videos for automatic captions and storing them locally. I use window.performance.getEntries() to find the link to the subtitles after enabling subtitles. But when I tried to open some of the links the day after I retrieved them I got a 404 error.



    Here is a now-defunct link to a YouTube video's captions that I retrieved yesterday: https://www.youtube.com/api/timedtext?sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&hl=en&signature=B50CC4269D15CD954D6946B6342194EDF9F6D01F.AF819BEDE91E0F31C8F02A04508E49FC02B4F504&xorp=True&v=FSyAehMdpyI&asr_langs=ja%2Cko%2Cen%2Cde%2Cpt%2Cru%2Cnl%2Cfr%2Cit%2Ces&xoaf=1&key=yttt1&caps=asr&expire=1541769833&lang=en&fmt=srv3



    I scraped the subtitles link from the same video and it's now changed!



    https://www.youtube.com/api/timedtext?xoaf=1&expire=1541822131&signature=585C6AB59561084DC1B7F963679FF2D916257EFA.5EBAF0C3037FD561A0636CA47CF95396773DB78B&hl=en&asr_langs=ja%2Cpt%2Cde%2Cko%2Cru%2Cen%2Cnl%2Ces%2Cfr%2Cit&sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&v=FSyAehMdpyI&caps=asr&key=yttt1&xorp=True&lang=en&fmt=srv3



    Is there a permanent solution for storing these automatic captions?










    share|improve this question























      up vote
      -1
      down vote

      favorite









      up vote
      -1
      down vote

      favorite











      I'm scraping YouTube videos for automatic captions and storing them locally. I use window.performance.getEntries() to find the link to the subtitles after enabling subtitles. But when I tried to open some of the links the day after I retrieved them I got a 404 error.



      Here is a now-defunct link to a YouTube video's captions that I retrieved yesterday: https://www.youtube.com/api/timedtext?sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&hl=en&signature=B50CC4269D15CD954D6946B6342194EDF9F6D01F.AF819BEDE91E0F31C8F02A04508E49FC02B4F504&xorp=True&v=FSyAehMdpyI&asr_langs=ja%2Cko%2Cen%2Cde%2Cpt%2Cru%2Cnl%2Cfr%2Cit%2Ces&xoaf=1&key=yttt1&caps=asr&expire=1541769833&lang=en&fmt=srv3



      I scraped the subtitles link from the same video and it's now changed!



      https://www.youtube.com/api/timedtext?xoaf=1&expire=1541822131&signature=585C6AB59561084DC1B7F963679FF2D916257EFA.5EBAF0C3037FD561A0636CA47CF95396773DB78B&hl=en&asr_langs=ja%2Cpt%2Cde%2Cko%2Cru%2Cen%2Cnl%2Ces%2Cfr%2Cit&sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&v=FSyAehMdpyI&caps=asr&key=yttt1&xorp=True&lang=en&fmt=srv3



      Is there a permanent solution for storing these automatic captions?










      share|improve this question













      I'm scraping YouTube videos for automatic captions and storing them locally. I use window.performance.getEntries() to find the link to the subtitles after enabling subtitles. But when I tried to open some of the links the day after I retrieved them I got a 404 error.



      Here is a now-defunct link to a YouTube video's captions that I retrieved yesterday: https://www.youtube.com/api/timedtext?sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&hl=en&signature=B50CC4269D15CD954D6946B6342194EDF9F6D01F.AF819BEDE91E0F31C8F02A04508E49FC02B4F504&xorp=True&v=FSyAehMdpyI&asr_langs=ja%2Cko%2Cen%2Cde%2Cpt%2Cru%2Cnl%2Cfr%2Cit%2Ces&xoaf=1&key=yttt1&caps=asr&expire=1541769833&lang=en&fmt=srv3



      I scraped the subtitles link from the same video and it's now changed!



      https://www.youtube.com/api/timedtext?xoaf=1&expire=1541822131&signature=585C6AB59561084DC1B7F963679FF2D916257EFA.5EBAF0C3037FD561A0636CA47CF95396773DB78B&hl=en&asr_langs=ja%2Cpt%2Cde%2Cko%2Cru%2Cen%2Cnl%2Ces%2Cfr%2Cit&sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&v=FSyAehMdpyI&caps=asr&key=yttt1&xorp=True&lang=en&fmt=srv3



      Is there a permanent solution for storing these automatic captions?







      api






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Nov 9 at 21:04









      st4rgut

      5391718




      5391718






















          1 Answer
          1






          active

          oldest

          votes

















          up vote
          0
          down vote













          OK, so all I had to do was remove the expire parameter in the URL and it worked again. eg deleted &expire=1541769833 in below link. Not sure what it's for in the first place if anyone could clarify that. Also not sure what the downvote is for, if you think somethings poorly worded say so or I won't know how to ask better questions.



          https://www.youtube.com/api/timedtext?sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&hl=en&signature=B50CC4269D15CD954D6946B6342194EDF9F6D01F.AF819BEDE91E0F31C8F02A04508E49FC02B4F504&xorp=True&v=FSyAehMdpyI&asr_langs=ja%2Cko%2Cen%2Cde%2Cpt%2Cru%2Cnl%2Cfr%2Cit%2Ces&xoaf=1&key=yttt1&caps=asr&lang=en&fmt=srv3






          share|improve this answer




















            Your Answer






            StackExchange.ifUsing("editor", function ()
            StackExchange.using("externalEditor", function ()
            StackExchange.using("snippets", function ()
            StackExchange.snippets.init();
            );
            );
            , "code-snippets");

            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "1"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













             

            draft saved


            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53233247%2fyoutube-network-request-strange-behaviour%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes








            up vote
            0
            down vote













            OK, so all I had to do was remove the expire parameter in the URL and it worked again. eg deleted &expire=1541769833 in below link. Not sure what it's for in the first place if anyone could clarify that. Also not sure what the downvote is for, if you think somethings poorly worded say so or I won't know how to ask better questions.



            https://www.youtube.com/api/timedtext?sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&hl=en&signature=B50CC4269D15CD954D6946B6342194EDF9F6D01F.AF819BEDE91E0F31C8F02A04508E49FC02B4F504&xorp=True&v=FSyAehMdpyI&asr_langs=ja%2Cko%2Cen%2Cde%2Cpt%2Cru%2Cnl%2Cfr%2Cit%2Ces&xoaf=1&key=yttt1&caps=asr&lang=en&fmt=srv3






            share|improve this answer
























              up vote
              0
              down vote













              OK, so all I had to do was remove the expire parameter in the URL and it worked again. eg deleted &expire=1541769833 in below link. Not sure what it's for in the first place if anyone could clarify that. Also not sure what the downvote is for, if you think somethings poorly worded say so or I won't know how to ask better questions.



              https://www.youtube.com/api/timedtext?sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&hl=en&signature=B50CC4269D15CD954D6946B6342194EDF9F6D01F.AF819BEDE91E0F31C8F02A04508E49FC02B4F504&xorp=True&v=FSyAehMdpyI&asr_langs=ja%2Cko%2Cen%2Cde%2Cpt%2Cru%2Cnl%2Cfr%2Cit%2Ces&xoaf=1&key=yttt1&caps=asr&lang=en&fmt=srv3






              share|improve this answer






















                up vote
                0
                down vote










                up vote
                0
                down vote









                OK, so all I had to do was remove the expire parameter in the URL and it worked again. eg deleted &expire=1541769833 in below link. Not sure what it's for in the first place if anyone could clarify that. Also not sure what the downvote is for, if you think somethings poorly worded say so or I won't know how to ask better questions.



                https://www.youtube.com/api/timedtext?sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&hl=en&signature=B50CC4269D15CD954D6946B6342194EDF9F6D01F.AF819BEDE91E0F31C8F02A04508E49FC02B4F504&xorp=True&v=FSyAehMdpyI&asr_langs=ja%2Cko%2Cen%2Cde%2Cpt%2Cru%2Cnl%2Cfr%2Cit%2Ces&xoaf=1&key=yttt1&caps=asr&lang=en&fmt=srv3






                share|improve this answer












                OK, so all I had to do was remove the expire parameter in the URL and it worked again. eg deleted &expire=1541769833 in below link. Not sure what it's for in the first place if anyone could clarify that. Also not sure what the downvote is for, if you think somethings poorly worded say so or I won't know how to ask better questions.



                https://www.youtube.com/api/timedtext?sparams=asr_langs%2Ccaps%2Cv%2Cxoaf%2Cxorp%2Cexpire&hl=en&signature=B50CC4269D15CD954D6946B6342194EDF9F6D01F.AF819BEDE91E0F31C8F02A04508E49FC02B4F504&xorp=True&v=FSyAehMdpyI&asr_langs=ja%2Cko%2Cen%2Cde%2Cpt%2Cru%2Cnl%2Cfr%2Cit%2Ces&xoaf=1&key=yttt1&caps=asr&lang=en&fmt=srv3







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Nov 9 at 21:18









                st4rgut

                5391718




                5391718



























                     

                    draft saved


                    draft discarded















































                     


                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53233247%2fyoutube-network-request-strange-behaviour%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Use pre created SQLite database for Android project in kotlin

                    Darth Vader #20

                    Ondo