How would this work? Do websites with rss feeds normally publish the url to that feed in some standard place?

feeds are usually advertised in the page header as below, with type set to either application/rss+xml or application/atom+xml.

Are there any third party extensions that do it?

i don’t know about chrom[e|ium], but i use Awesome RSS for firefox.

You need to enable JavaScript to run this app.