X
Tap here to go to the mobile version of the site.

ஆதரவு மன்றம்

How to get news feeds (updates) from websites that DON'T support feeds or rss?

  • 19 replies
  • 1 இந்த பிரச்சனை உள்ளது
  • Last reply by McCoy
பதிவிடப்பட்டது

Hi,

I have several websites where news are posted daily. In average around 800 feeds per day per one website. The websites DON'T support RSS and when i was trying some free of charge services like TheOldReader, etc I got error message saying that website(s) don't support feeds at all. I really want to get those news that are being posted to my gmail email account IMMEDIATELY (this is the most important!) when they occur regardless if i have computer ON or OFF. I was trying different website updates delivery services but it didn't work. May i ask what else could i do so i wouldn't need to check every single website every single minute if there is any new post or not? Why did i say minute? Because timing is very important - i must get it as fast as possible. Example of such website is:

https://uk.reuters.com/news/archive/bondsNews

and many more. Whenever something new is posted to this exact website and NOT main one uk.reuters.com, I would like to get email message to my gmail with appropriate title and content including redirect link.

Could anyone please tell me what can be done?

Thank you in advance.

Hi, I have several websites where news are posted daily. In average around 800 feeds per day per one website. The websites DON'T support RSS and when i was trying some free of charge services like TheOldReader, etc I got error message saying that website(s) don't support feeds at all. I really want to get those news that are being posted to my gmail email account IMMEDIATELY (this is the most important!) when they occur regardless if i have computer ON or OFF. I was trying different ''website updates delivery'' services but it didn't work. May i ask what else could i do so i wouldn't need to check every single website every single minute if there is any new post or not? Why did i say ''minute''? Because timing is very important - i must get it as fast as possible. Example of such website is: https://uk.reuters.com/news/archive/bondsNews and many more. Whenever something new is posted to this exact website and NOT main one uk.reuters.com, I would like to get email message to my gmail with appropriate title and content including redirect link. Could anyone please tell me what can be done? Thank you in advance.

Additional System Details

நிறுவப்பட்ட நிரல்கள்

  • Shockwave Flash 32.0 r0

பயன்பாடு

  • User Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:64.0) Gecko/20100101 Firefox/64.0

கூடுதல் தகவல்

jscher2000
  • Top 10 Contributor
8639 தீர்வுகள் 70667 பதில்கள்
பதிவிடப்பட்டது

There are numerous web-based services that watch websites and notify you of changes. Most of the free ones were "once a day" and some didn't support JavaScript. The following came up in a search as being able to check at 5 minute intervals at one of their higher price points; I haven't tried them myself:

There are numerous web-based services that watch websites and notify you of changes. Most of the free ones were "once a day" and some didn't support JavaScript. The following came up in a search as being able to check at 5 minute intervals at one of their higher price points; I haven't tried them myself: * https://visualping.io/pricing * https://changetower.com/pricing/ * https://www.wachete.com/#pricing
பதிவிடப்பட்டது

கேள்வியின் உரிமையாளர்

jscher2000 said

There are numerous web-based services that watch websites and notify you of changes. Most of the free ones were "once a day" and some didn't support JavaScript. The following came up in a search as being able to check at 5 minute intervals at one of their higher price points; I haven't tried them myself:

thank you for your reply but i need free of charge application (service) with instant (max 1 second) unlimited email alerts.

''jscher2000 [[#answer-1184479|said]]'' <blockquote> There are numerous web-based services that watch websites and notify you of changes. Most of the free ones were "once a day" and some didn't support JavaScript. The following came up in a search as being able to check at 5 minute intervals at one of their higher price points; I haven't tried them myself: * https://visualping.io/pricing * https://changetower.com/pricing/ * https://www.wachete.com/#pricing </blockquote> thank you for your reply but i need free of charge application (service) with instant (max 1 second) unlimited email alerts.
jscher2000
  • Top 10 Contributor
8639 தீர்வுகள் 70667 பதில்கள்
பதிவிடப்பட்டது

Hi puppy0, when you find that, please let us know so we can all benefit from your further research.

Hi puppy0, when you find that, please let us know so we can all benefit from your further research.
பதிவிடப்பட்டது

கேள்வியின் உரிமையாளர்

jscher2000 said

Hi puppy0, when you find that, please let us know so we can all benefit from your further research.

I did around 10% of work on my own doing my research. The other 90% still remains, previously I was at zero. The goal is to get from several different websites (current quantity is around 80) email alerts when new posts (news) are on the websites. So far I did the progress in the following two steps:

1. all wanted websites are in Bookmarks menu inside the SAME custom created folder. This lets me click with right mouse button on custom created folder's name (inside bookmarks menu) and choose Open all in tabs. Obviously since its large amount of websites, this will slow down by far entire firefox browser while all the websites will be both opening AND loading. If i will see any freezing of browser, i will simply create more than one custom folder (inside bookmarks menu). This way less websites will be opened upon clicking each open all in tabs.

2. I somehow managed to find custom firefox's plugin which can automatically REFRESH all opened tabs (websites). It contains the feature of stopping it to so it doesn't refresh when i don't want to. The key information is that all opened tabs are refreshed so i don't need to be worried that anything would not be refreshed. Another feature is to define time interval. Having said that, whenever, after time interval passes, i manually click on any tab (website) i will always see most updated content.

This is what i have done so far. I know its not a lot but still a little progress. Major two upcoming steps to be done are the following ones AND I AM ASKING EVERYONE to please tell me your suggestion what could i do in the following two steps:

Firstly, I need to find a tool or even firefox addon which will be able to recognize new content, e.g. what is different in current content comparing to the content after refreshing the website (webpage). So i am looking for the tool (firefox addon) which will be able to differ previous content from new content - defining what is new, IF anything (new posts/new news), on the exact URL's webpage/website. I tried many different services. They where either paid ones that i cannot afford or too limited (quantity of checks) of too large delay (max allowed is one second which basically means i need 24/7 instant checking).

Secondly, upon recognizing the new content, i need this title+body of the news to be sent to my defined email address.

''jscher2000 [[#answer-1184615|said]]'' <blockquote> Hi puppy0, when you find that, please let us know so we can all benefit from your further research. </blockquote> I did around 10% of work on my own doing my research. The other 90% still remains, previously I was at zero. The goal is to get from several different websites (current quantity is around 80) email alerts when new posts (news) are on the websites. So far I did the progress in the following two steps: 1. all wanted websites are in Bookmarks menu inside the SAME custom created folder. This lets me click with right mouse button on custom created folder's name (inside bookmarks menu) and choose ''Open all in tabs''. Obviously since its large amount of websites, this will slow down by far entire firefox browser while all the websites will be both opening AND loading. If i will see any freezing of browser, i will simply create more than one custom folder (inside bookmarks menu). This way less websites will be opened upon clicking each ''open all in tabs''. 2. I somehow managed to find custom firefox's plugin which can automatically REFRESH '''all''' opened tabs (websites). It contains the feature of stopping it to so it doesn't refresh when i don't want to. The key information is that ''all'' opened tabs are refreshed so i don't need to be worried that anything would not be refreshed. Another feature is to define time interval. Having said that, whenever, after time interval passes, i manually click on any tab (website) i will always see most updated content. This is what i have done so far. I know its not a lot but still a little progress. Major two upcoming steps to be done are the following ones '''AND I AM ASKING EVERYONE''' to please tell me your suggestion what could i do in the following two steps: Firstly, I need to find a tool or even firefox addon which will be able to recognize new content, e.g. what is different in current content comparing to the content after refreshing the website (webpage). So i am looking for the tool (firefox addon) which will be able to differ previous content from new content - defining what is new, IF anything (new posts/new news), on the exact URL's webpage/website. I tried many different services. They where either paid ones that i cannot afford or too limited (quantity of checks) of too large delay (max allowed is one second which basically means i need 24/7 instant checking). Secondly, upon recognizing the new content, i need this title+body of the news to be sent to my defined email address.
McCoy
  • Top 10 Contributor
520 தீர்வுகள் 4894 பதில்கள்
பதிவிடப்பட்டது

Hello puppy0,

Would these add-ons come close to (or do) what you want  ?

https://addons.mozilla.org/en-US/firefox/addon/check4change/

and :

https://addons.mozilla.org/en-US/firefox/addon/update-scanner/

Hello puppy0, Would these add-ons come close to (or do) what you want ? https://addons.mozilla.org/en-US/firefox/addon/check4change/ and : https://addons.mozilla.org/en-US/firefox/addon/update-scanner/
பதிவிடப்பட்டது

கேள்வியின் உரிமையாளர்

McCoy said

Hello puppy0, Would these add-ons come close to (or do) what you want  ? https://addons.mozilla.org/en-US/firefox/addon/check4change/ and : https://addons.mozilla.org/en-US/firefox/addon/update-scanner/

Thank you for your reply. The problem is that i want to get alert (preferable email) when ENTIRE new news post (title+body) is posted and not only some small piece of text (e.g. word or numerical value). In Check4Change plugin, i need to select a piece of text to be monitored when it changes. But i need to know when NEW entire post is created. Not just some small piece of text.

Regarding Update Scanner plugin: as far as i see it may monitor entire webpages so new posts should be recognized. But the problem is method of alert: it says that changes are being HIGHLIGHTED. So in order to see any highlighting effect (consequence of new news post), i would have to click all the time each and every opened tab ( * ) manually. What kind of benefit would i have from this? If i was doing this manually, i would manually see new posts on my own. Thats the problem. I need alerts (preferable email) to notify my about new posts.

( * ) i am assuming that both addons you posted for me, McCoy, require tabs (webpages being interested for) OPENED all the time which means the addons you mentioned DON'T offer possibility of saving URLs and monitoring them at the background.

I also found on my own:

https://addons.mozilla.org/en-US/firefox/addon/distill-web-monitor-ff/

But its a paid service, third party web application. Too low time periods of checks, too low quantity of URLs being monitored.

Hopefully someone could please still help...

''McCoy [[#answer-1184810|said]]'' <blockquote> Hello puppy0, Would these add-ons come close to (or do) what you want ? https://addons.mozilla.org/en-US/firefox/addon/check4change/ and : https://addons.mozilla.org/en-US/firefox/addon/update-scanner/ </blockquote> Thank you for your reply. The problem is that i want to get alert (preferable email) when ENTIRE new news post (title+body) is posted and not only some small piece of text (e.g. word or numerical value). In Check4Change plugin, i need to select a piece of text to be monitored when it changes. But i need to know when NEW entire post is created. Not just some small piece of text. Regarding ''Update Scanner'' plugin: as far as i see it may monitor entire webpages so new posts should be recognized. But the problem is method of alert: it says that changes are being HIGHLIGHTED. So in order to see any highlighting effect (consequence of new news post), i would have to click all the time each and every opened tab ( * ) manually. What kind of benefit would i have from this? If i was doing this manually, i would manually see new posts on my own. Thats the problem. I need alerts (preferable email) to notify my about new posts. ( * ) i am assuming that both addons you posted for me, McCoy, require tabs (webpages being interested for) OPENED all the time which means the addons you mentioned DON'T offer possibility of saving URLs and monitoring them at the background. I also found on my own: https://addons.mozilla.org/en-US/firefox/addon/distill-web-monitor-ff/ But its a paid service, third party web application. Too low time periods of checks, too low quantity of URLs being monitored. Hopefully someone could please still help...
McCoy
  • Top 10 Contributor
520 தீர்வுகள் 4894 பதில்கள்
பதிவிடப்பட்டது

That extension that you found :

https://addons.mozilla.org/en-US/firefox/addon/distill-web-monitor-ff/

You say that it's a paid service - all add-ons from addons.mozilla.org are free (donations are of course welcome).

You could ask the developer(s) of the extension if maybe they could add what you are looking for ......

That extension that you found : https://addons.mozilla.org/en-US/firefox/addon/distill-web-monitor-ff/ You say that it's a paid service - all add-ons from addons.mozilla.org are free (donations are of course welcome). You could ask the developer(s) of the extension if maybe they could add what you are looking for ......
பதிவிடப்பட்டது

கேள்வியின் உரிமையாளர்

there is a link on addon's webpage. If you click it, you will see Pricing at the top of the screen.

Also functionality is questionable since it says that addon won't be available anymore for firefox versions 57 or newer.

Anything else to alert me on new news posts? It can be third party tool and not firefox's addon also. Here are few URLs (out of many) i am interested for and main problem is always the same: RSS on all of them is NOT supported:

https://uk.reuters.com/news/archive/bondsNews https://www.reuters.com/news/archive/asia https://af.reuters.com/news/archive/commoditiesNews http://www.netdania.com/Products/News/ResearchAnalysis.aspx https://www.fxstreet.com/news/latest?q=&hPP=15&idx=FxsIndexPro&p=0 https://aib.ie/fxcentre/i-want-to/read-news.urncolonnewsmlcolonreuters_comcolon20181221colonnL3N1YQ06K#compmarketnewsheadlines https://money.usnews.com/investing/news https://www.insidefutures.com/articles/?src=header https://sputniknews.com/business/ https://www.forextraders.com/forex-news/

there is a link on addon's webpage. If you click it, you will see Pricing at the top of the screen. Also functionality is questionable since it says that addon won't be available anymore for firefox versions 57 or newer. Anything else to alert me on new news posts? It can be third party tool and not firefox's addon also. Here are few URLs (out of many) i am interested for and main problem is always the same: RSS on all of them is NOT supported: https://uk.reuters.com/news/archive/bondsNews https://www.reuters.com/news/archive/asia https://af.reuters.com/news/archive/commoditiesNews http://www.netdania.com/Products/News/ResearchAnalysis.aspx https://www.fxstreet.com/news/latest?q=&hPP=15&idx=FxsIndexPro&p=0 https://aib.ie/fxcentre/i-want-to/read-news.urncolonnewsmlcolonreuters_comcolon20181221colonnL3N1YQ06K#compmarketnewsheadlines https://money.usnews.com/investing/news https://www.insidefutures.com/articles/?src=header https://sputniknews.com/business/ https://www.forextraders.com/forex-news/
McCoy
  • Top 10 Contributor
520 தீர்வுகள் 4894 பதில்கள்
பதிவிடப்பட்டது

The only thing I can think of is to contact the websites' owners and request an RSS feed (a lot of work, I know).

The only thing I can think of is to contact the websites' owners and request an RSS feed (a lot of work, I know).
பதிவிடப்பட்டது

கேள்வியின் உரிமையாளர்

They wouldn't due to two main reasons:

out of tens of thousands of people reading their news posts every day, i would be completely random stranger and they see no benefit in even lifting a finger for me.

some of those websites also provide expensive custom Terminal solution where those news posts, as well as the ones from many other quality sources, are occurring automatically. If they offered RSS then everyone would stop their Terminal subscription and they would be in loss.

They wouldn't due to two main reasons: out of tens of thousands of people reading their news posts every day, i would be completely random stranger and they see no benefit in even lifting a finger for me. some of those websites also provide expensive custom Terminal solution where those news posts, as well as the ones from many other quality sources, are occurring automatically. If they offered RSS then everyone would stop their Terminal subscription and they would be in loss.
McCoy
  • Top 10 Contributor
520 தீர்வுகள் 4894 பதில்கள்
பதிவிடப்பட்டது
I found this for you : https://www.makeuseof.com/tag/turn-website-rss-feed/ And as the above is a Chrome extension : https://www.thewindowsclub.com/install-chrome-extensions-on-firefox https://addons.mozilla.org/en-US/firefox/addon/chrome-store-foxified/ Any good ?
பதிவிடப்பட்டது

கேள்வியின் உரிமையாளர்

Thank you for those links but before i posted my first message, i had already researched on google for at least 20 different keywords (one and more words) and checked at least 10 pages for each keyword. Didn't find anything free of charge, unlimited feeds and fast enough. It is irrelevant if within firefox or third party application. So i also reviewed the content on the first link you sent (makeuseof dot com) but nothing useful there because Page2Rss service is not available anymore. Neither Kimono extension (chrome).

Although I am aware that with second link you wanted to show me the method how to get Chrome browser addons working on firefox. Firstly i would like to say thank you again for letting me know but unfortunately it won't work because on Kimono webpage clearly says that piece of the content need to be chosen in order to track when this exact piece gets changed. So problem is the same as in Check4Change which i commented above in one of my previous messages.

Some of the websites i am interested for don't support RSS. When i tried those websites in different alerting applications, the error message was similar to No Feeds Found.

I also found this:

https://addons.mozilla.org/en-US/firefox/addon/newsrdrus-checker/?src=search

but error is: "We could not detect a feed at the URL provided"

Thank you for those links but before i posted my first message, i had already researched on google for at least 20 different keywords (one and more words) and checked at least 10 pages for each keyword. Didn't find anything free of charge, unlimited feeds and fast enough. It is irrelevant if within firefox or third party application. So i also reviewed the content on the first link you sent (makeuseof dot com) but nothing useful there because Page2Rss service is not available anymore. Neither Kimono extension (chrome). Although I am aware that with second link you wanted to show me the method how to get Chrome browser addons working on firefox. Firstly i would like to say thank you again for letting me know but unfortunately it won't work because on Kimono webpage clearly says that piece of the content need to be chosen in order to track when this exact piece gets changed. So problem is the same as in Check4Change which i commented above in one of my previous messages. Some of the websites i am interested for don't support RSS. When i tried those websites in different alerting applications, the error message was similar to No Feeds Found. I also found this: https://addons.mozilla.org/en-US/firefox/addon/newsrdrus-checker/?src=search but error is: "We could not detect a feed at the URL provided"

puppy0 மூலமாக திருத்தப்பட்டது

McCoy
  • Top 10 Contributor
520 தீர்வுகள் 4894 பதில்கள்
பதிவிடப்பட்டது

I'm all out of ideas - sorry .....

I'm all out of ideas - sorry .....
பதிவிடப்பட்டது

கேள்வியின் உரிமையாளர்

Do you think firefox feature named Inspector which is accessable via:

Tools menu\Web Developer

would anyhow help?

Do you think firefox feature named ''Inspector'' which is accessable via: Tools menu\Web Developer would anyhow help?
McCoy
  • Top 10 Contributor
520 தீர்வுகள் 4894 பதில்கள்
பதிவிடப்பட்டது

puppy0 said

Do you think firefox feature named Inspector which is accessable via: Tools menu\Web Developer would anyhow help?

Would you please use this link to find out what the Inspector is all about .....

I'm really sorry that I haven't been able to help you with your problem  :(

''puppy0 [[#answer-1185008|said]]'' <blockquote> Do you think firefox feature named ''Inspector'' which is accessable via: Tools menu\Web Developer would anyhow help? </blockquote> Would you please use [https://www.google.nl/search?authuser=0&source=hp&ei=RcMoXM__LtGcsAeVs56gCg&q=in+firefox%3A+what+does+the+Inspector+in+web+developer+do+%3F&btnK=Google+Search&oq=in+firefox%3A+what+does+the+Inspector+in+web+developer+do+%3F&gs_l=psy-ab.3..33i22i29i30.11212.29762..30161...4.0..0.618.5237.52j3j0j2j0j1......0....1..gws-wiz.....6..0j35i39j0i22i30j33i160.MaQ_2ylEx4gthis this link ] to find out what the Inspector is all about ..... I'm really sorry that I haven't been able to help you with your problem :(
McCoy
  • Top 10 Contributor
520 தீர்வுகள் 4894 பதில்கள்
பதிவிடப்பட்டது

Just thought of something :

Maybe you could post here and see if somebody would be willing to develop an extension that will do what you want :

https://discourse.mozilla.org/c/add-ons

Or : ask the developers of the extensions, already mentioned in this thread, if they could/would add what you want to their extension (?)

Just thought of something : Maybe you could post here and see if somebody would be willing to develop an extension that will do what you want : https://discourse.mozilla.org/c/add-ons Or : ask the developers of the extensions, already mentioned in this thread, if they could/would add what you want to their extension (?)
பதிவிடப்பட்டது

கேள்வியின் உரிமையாளர்

I will try to ask for extension development. Even if your replies didn't anyhow help me, I would still like to thank you for your time.

I will try to ask for extension development. Even if your replies didn't anyhow help me, I would still like to thank you for your time.
பதிவிடப்பட்டது

கேள்வியின் உரிமையாளர்

i didn't get any reply there

i didn't get any reply there

puppy0 மூலமாக திருத்தப்பட்டது

McCoy
  • Top 10 Contributor
520 தீர்வுகள் 4894 பதில்கள்
பதிவிடப்பட்டது

puppy0 said

i didn't get any reply there

You expect a reply right away  ?

It's weekend - and also that time of the year where many people are on vacation.

Most of these people are volunteers, just like the people who answer questions on this support forum (in their spare time).

I know that you're really anxious to get this 'feature' as soon as possible, but I'm afraid that you'll have to be patient ......

''puppy0 [[#answer-1185088|said]]'' <blockquote> i didn't get any reply there </blockquote> You expect a reply right away ? It's weekend - and also that time of the year where many people are on vacation. Most of these people are volunteers, just like the people who answer questions on this support forum (in their spare time). I know that you're really anxious to get this 'feature' as soon as possible, but I'm afraid that you'll have to be patient ......