X
Tryk her for at gå til webstedets mobilversion.

Supportforum

Export console xhr responses

Skrevet

I'm trying to automate a part of my daily work on a website I'm using (not developping). I have to crawl several lists on the website, dig an item in the list, to check some values, and do it again and again ...

Im used to developping in Powershell and python, not with a web browser. I have admin rights on the machine I'm working on. I'd like to use this to catch the json answers of the website (all of them), parse the answers for some values, and automate some kind of popup "Hey, This item in the list is between 90 and 100 !"

No code to show yet, that's what i'm looking for : basic solution for json interception while i'm crawling. I have good knowledge of json parsing using python/powershell, the hard part for me is catching the answers ...

A real time export of all json answers of the network console will be a perfect basis for this ... How can this be done with firefox extension ? I just need a base to start.

Thank you very much for any help you can give. And apologies for my average english ...

I'm trying to automate a part of my daily work on a website I'm using (not developping). I have to crawl several lists on the website, dig an item in the list, to check some values, and do it again and again ... Im used to developping in Powershell and python, not with a web browser. I have admin rights on the machine I'm working on. I'd like to use this to catch the json answers of the website (all of them), parse the answers for some values, and automate some kind of popup "Hey, This item in the list is between 90 and 100 !" No code to show yet, that's what i'm looking for : basic solution for json interception while i'm crawling. I have good knowledge of json parsing using python/powershell, the hard part for me is catching the answers ... A real time export of all json answers of the network console will be a perfect basis for this ... How can this be done with firefox extension ? I just need a base to start. Thank you very much for any help you can give. And apologies for my average english ...

Ændret af cor-el den

Citér

Yderligere systemdetaljer

Program

  • User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:73.0) Gecko/20100101 Firefox/73.0

Yderligere information

Luk
cor-el
  • Top 10 Contributor
  • Moderator
17685 løsninger 159996 svar
You can create a HAR archive (HTTP Archive) for data in the Web Console (right-click: Save All As HAR). *https://developer.mozilla.org/en-US/Tools/Network_Monitor *https://developer.mozilla.org/en-US/docs/Mozilla/Add-ons/WebExtensions/API/devtools.network/getHAR ---- *https://www.softwareishard.com/blog/har-12-spec/ *https://www.softwareishard.com/blog/har-viewer/
Fandt du dette nyttigt?
Citér

Spørgsmålsstiller

Thank You Cor-el !

I managed to get this to work : function logJson(requestDetails) {

 console.log("loading : " + requestDetails.url);
 console.log("loaded Json : " + requestDetails.type );

}

browser.webRequest.onCompleted.addListener(

 logRequests,
 {urls: ["*://*.mywebsite.com/*"],
  types: ["xmlhttprequest"]
 }

);

This code allows me to get a log line on every json that's loaded in the webpage (confirmed with network console) I tried to adapt the code to save the jsons on my Hard drive in real time.

The code i found with your links allows to show the urls of loaded pages, on a click ... Is there a way to actually save this HAR as a file on a hard drive in realtime, or a regular basis ? (every second ...)

The aim for me is to analyse the loaded jsons in realtime, to show a popup when certains conditions are met inside the json (heavy values calculations to do ...)

either by saving the jsons somewher, so that I can analyse them with an outside tool (script)

Either by opening them "on the fly" inside the firefox extension, to make the calculation.

With the given code, I can't figure a way to extract the json response ...

Thank You Cor-el ! I managed to get this to work : function logJson(requestDetails) { console.log("loading : " + requestDetails.url); console.log("loaded Json : " + requestDetails.type ); } browser.webRequest.onCompleted.addListener( logRequests, {urls: ["*://*.mywebsite.com/*"], types: ["xmlhttprequest"] } ); This code allows me to get a log line on every json that's loaded in the webpage (confirmed with network console) I tried to adapt the code to save the jsons on my Hard drive in real time. The code i found with your links allows to show the urls of loaded pages, ''on a click'' ... Is there a way to actually save this HAR as a file on a hard drive in realtime, or a regular basis ? (every second ...) The aim for me is to analyse the loaded jsons in realtime, to show a popup when certains conditions are met inside the json (heavy values calculations to do ...) either by saving the jsons somewher, so that I can analyse them with an outside tool (script) Either by opening them "on the fly" inside the firefox extension, to make the calculation. With the given code, I can't figure a way to extract the json response ...
Fandt du dette nyttigt?
Citér
Stil et spørgsmål

Du skal logge ind på din konto for at svare på et indlæg. Start et nyt spørgsmål, hvis du ikke har en konto endnu.