Reading the BOM data from web page

Discussion in 'General Discussion' started by abg, Feb 11, 2010.

  1. abg

    abg

    Joined:
    Dec 25, 2007
    Messages:
    208
    Likes Received:
    2
    Location:
    Sydney
    Just wondered if anyone has tried reading data from a web site like the BOM.

    http://www.bom.gov.au/products/IDN60901/IDN60901.94759.shtml

    Any ideas on the most effective way to do this? Is there a way to grab the source of the page (and then it could be parsed).

    I am after the 1/2 hourly updates which come in the form:

    11/02:30pm 28.0 29.8 20.3 63 5.1 ENE 11 19 6 10 - 0.0

    Any suggestions most welcome!

    Thanks

    Andrew
     
    abg, Feb 11, 2010
    #1
  2. abg

    Conformist

    Joined:
    Aug 4, 2004
    Messages:
    787
    Likes Received:
    74
    Location:
    Adelaide, South Australia
    Last edited by a moderator: Feb 11, 2010
    Conformist, Feb 11, 2010
    #2
  3. abg

    abg

    Joined:
    Dec 25, 2007
    Messages:
    208
    Likes Received:
    2
    Location:
    Sydney
    Thanks for the feedback but I'm after the specific half hourly data for the Terrey Hills weather station. I don't think this is placed on the ftp site (at least that frequently).
     
    abg, Feb 11, 2010
    #3
  4. abg

    Darpa

    Joined:
    Apr 30, 2006
    Messages:
    426
    Likes Received:
    0
    Location:
    Australia
    The only other formats for weather OBSERVATIONS (not forecasts) that the BOM gives out for the data you want, (other than paid versions), for Terrey Hills, is the following:

    Comma delimited format used in spreadsheet applications
    http://www.bom.gov.au/fwo/IDN60901/IDN60901.94759.axf

    JavaScript Object Notation format (JSON) in row-major order
    http://www.bom.gov.au/fwo/IDN60901/IDN60901.94759.json

    JavaScript Object Notation format (JSON) in column-major order
    http://www.bom.gov.au/fwo/IDN60901/IDN60901.94759.jsn

    I would assume that the comma delimited format will most likely be the most use to you.
     
    Darpa, Feb 11, 2010
    #4
  5. abg

    abg

    Joined:
    Dec 25, 2007
    Messages:
    208
    Likes Received:
    2
    Location:
    Sydney
    Many thanks. Missed that one. Obvious when one looks at the bottom of the Terrey Hills page...!

    Would I be pushing my luck to ask for suggestions on how to automate the download of the file? I have Homegate and a PAC.
     
    abg, Feb 11, 2010
    #5
  6. abg

    ashleigh Moderator

    Joined:
    Aug 4, 2004
    Messages:
    2,397
    Likes Received:
    26
    Location:
    Adelaide, South Australia
    Be careful. Any solution you come up with is then at the mercy of the BOM changing their web site / URL / file format... whatever.
     
    ashleigh, Feb 11, 2010
    #6
Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments (here). After that, you can post your question and our members will help you out.