the frequent words in DMOZ (in English and in French)

Discussion in 'Using ODP Data' started by seascrystal, Dec 2, 2011.

  1. seascrystal

    seascrystal New Member

    Joined:
    Dec 2, 2011
    Messages:
    4
    Hello,
    As there is some problem of ODP data downdload, who can tell me the most frequent no stop English and French words (with their frequency if possible) in DMOZ (for example: 100 first)? I will be very thankful to you!
  2. seascrystal

    seascrystal New Member

    Joined:
    Dec 2, 2011
    Messages:
    4
    And nearly how many documents (including all the categories) in DOMZ ?
  3. Elper

    Elper DMOZ Meta RZ Admin

    Joined:
    Sep 15, 2004
    Messages:
    1,956
    Big numbers - and not ones which really interest us, so I don't have them to hand...
    It's possible that one of our data users has extracted the numbers and words, but I'm not aware of any.

    Assuming the front page count is correct, 1,008,705 categories...
    For public pages (one description per category) that'll make over 2 million.

    The available RDF, which is the most accurate way to check, is described here: http://rdf.dmoz.org/

    For frequent words, they are probably much the same as normal averages, things like "and, the; et, le, la" - again analysing the RDF should give you what you want
    :)

Share This Page