X
Tocca qui per la versione per piattaforma mobile del sito.

Forum di supporto

Export console xhr responses

Inserita

I'm trying to automate a part of my daily work on a website I'm using (not developping). I have to crawl several lists on the website, dig an item in the list, to check some values, and do it again and again ...

Im used to developping in Powershell and python, not with a web browser. I have admin rights on the machine I'm working on. I'd like to use this to catch the json answers of the website (all of them), parse the answers for some values, and automate some kind of popup "Hey, This item in the list is between 90 and 100 !"

No code to show yet, that's what i'm looking for : basic solution for json interception while i'm crawling. I have good knowledge of json parsing using python/powershell, the hard part for me is catching the answers ...

A real time export of all json answers of the network console will be a perfect basis for this ... How can this be done with firefox extension ? I just need a base to start.

Thank you very much for any help you can give. And apologies for my average english ...

I'm trying to automate a part of my daily work on a website I'm using (not developping). I have to crawl several lists on the website, dig an item in the list, to check some values, and do it again and again ... Im used to developping in Powershell and python, not with a web browser. I have admin rights on the machine I'm working on. I'd like to use this to catch the json answers of the website (all of them), parse the answers for some values, and automate some kind of popup "Hey, This item in the list is between 90 and 100 !" No code to show yet, that's what i'm looking for : basic solution for json interception while i'm crawling. I have good knowledge of json parsing using python/powershell, the hard part for me is catching the answers ... A real time export of all json answers of the network console will be a perfect basis for this ... How can this be done with firefox extension ? I just need a base to start. Thank you very much for any help you can give. And apologies for my average english ...

Modificato da cor-el il

Citazione

Dettagli aggiuntivi sul sistema

Applicazione

  • User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:73.0) Gecko/20100101 Firefox/73.0

Ulteriori informazioni

cor-el
  • Top 10 Contributor
  • Moderator
17768 soluzioni 160700 risposte
You can create a HAR archive (HTTP Archive) for data in the Web Console (right-click: Save All As HAR). *https://developer.mozilla.org/en-US/Tools/Network_Monitor *https://developer.mozilla.org/en-US/docs/Mozilla/Add-ons/WebExtensions/API/devtools.network/getHAR ---- *https://www.softwareishard.com/blog/har-12-spec/ *https://www.softwareishard.com/blog/har-viewer/
È stato utile questo messaggio?
Citazione

Utente che ha posto la domanda

Thank You Cor-el !

I managed to get this to work : function logJson(requestDetails) {

 console.log("loading : " + requestDetails.url);
 console.log("loaded Json : " + requestDetails.type );

}

browser.webRequest.onCompleted.addListener(

 logRequests,
 {urls: ["*://*.mywebsite.com/*"],
  types: ["xmlhttprequest"]
 }

);

This code allows me to get a log line on every json that's loaded in the webpage (confirmed with network console) I tried to adapt the code to save the jsons on my Hard drive in real time.

The code i found with your links allows to show the urls of loaded pages, on a click ... Is there a way to actually save this HAR as a file on a hard drive in realtime, or a regular basis ? (every second ...)

The aim for me is to analyse the loaded jsons in realtime, to show a popup when certains conditions are met inside the json (heavy values calculations to do ...)

either by saving the jsons somewher, so that I can analyse them with an outside tool (script)

Either by opening them "on the fly" inside the firefox extension, to make the calculation.

With the given code, I can't figure a way to extract the json response ...

Thank You Cor-el ! I managed to get this to work : function logJson(requestDetails) { console.log("loading : " + requestDetails.url); console.log("loaded Json : " + requestDetails.type ); } browser.webRequest.onCompleted.addListener( logRequests, {urls: ["*://*.mywebsite.com/*"], types: ["xmlhttprequest"] } ); This code allows me to get a log line on every json that's loaded in the webpage (confirmed with network console) I tried to adapt the code to save the jsons on my Hard drive in real time. The code i found with your links allows to show the urls of loaded pages, ''on a click'' ... Is there a way to actually save this HAR as a file on a hard drive in realtime, or a regular basis ? (every second ...) The aim for me is to analyse the loaded jsons in realtime, to show a popup when certains conditions are met inside the json (heavy values calculations to do ...) either by saving the jsons somewher, so that I can analyse them with an outside tool (script) Either by opening them "on the fly" inside the firefox extension, to make the calculation. With the given code, I can't figure a way to extract the json response ...
È stato utile questo messaggio?
Citazione
Richiedi supporto

Bisogna accedere al proprio account per rispondere nelle discussioni. Se non si possiede ancora un account, inserire una nuova richiesta.