dmoz search vs ODP RDF dumps

Discussion in 'Using DMOZ Data' started by gopher, Feb 24, 2011.

  1. gopher

    gopher New Member

    Joined:
    Feb 24, 2011
    Messages:
    4
    Hi,
    I've noticed that there is a new updated set of ODP RDF dumps @ http://rdf.dmoz.org/rdf/ as of 18-Feb-2011 17:07
    I've found a number of sites that can be found by using the search feature on DMOZ, yet they are not in the most recent RDF files.
    Additionally, when browsing to the category returned by 'search', they are not listed.
    It appears that the category listings are up to date, yet the search database function is using outdated data.

    ex: (hope this is not against rules of posting link, as I'm posting an internal DMOZ link...)
    http://dmoztools.net/search?q=u:torchlit.net returns 1 result.
    Yet the category: http://dmoztools.net/Games/Video_Games/Roleplaying/T/Torchlight/ does not list the site

    Question: How soon is the search function updated to use the most current data? if at all?

    Thanks
     
  2. windharp

    windharp DMOZ Meta DMOZ Meta

    Joined:
    Apr 30, 2002
    Messages:
    9,203
    Generally, search is based on the most current RDF file, which is copied over to the search server automatically. But as it happened quite frequently after RDF generation problems in the past, I assume the automatic update of the search server is not working yet.

    In DMOZ 1.0 the date of the used RDF file was shown on the search results. Unfortunately it currently isn't, which makes it less obviuos which date the search data has.
     
  3. photofox

    photofox DMOZ Admin RZ Admin

    Joined:
    Jun 9, 2010
    Messages:
    2,108
    Location:
    [Right here]
    With the implementation of DMOZ 2.0 search no longer uses the RDF, the search database updates daily (roughly every 6 hours if I remember correctly). There is a bug causing removed listings to still show in search results even after the database updates. AOL is aware of the problem and is working to correct it.
     
  4. gopher

    gopher New Member

    Joined:
    Feb 24, 2011
    Messages:
    4
    re: the bug. shouldn't be to difficult to fix. ( :2cents: )
    I caught the discrepancy while developing a php script that uses the RDF data.
    If AOL needs help, I'd be happy to lend a hand... heh :lol:

    ok, thank you for your replies.
     
  5. windharp

    windharp DMOZ Meta DMOZ Meta

    Joined:
    Apr 30, 2002
    Messages:
    9,203
    Oh, nice. Well, you can't be on top of all the information ^^
     

Share This Page