{"id":153,"date":"2008-10-23T00:14:31","date_gmt":"2008-10-23T04:14:31","guid":{"rendered":"http:\/\/jodischneider.com\/blog\/?p=153"},"modified":"2008-10-23T07:47:34","modified_gmt":"2008-10-23T11:47:34","slug":"nytimes-topics-quirky-useful-classification-finding-aid","status":"publish","type":"post","link":"https:\/\/jodischneider.com\/blog\/2008\/10\/23\/nytimes-topics-quirky-useful-classification-finding-aid\/","title":{"rendered":"NYTimes Topics: Quirky, Useful Classification, Finding Aid"},"content":{"rendered":"

Yesterday the NYTimes announced<\/a> a new API, TimesTags, “based on the taxonomy and controlled vocabulary used by Times indexers since 1851”. The browseable version of this vocabulary, http:\/\/topics.nytimes.com\/<\/a> , is a great entry into NYTimes articles published since 1981.
\n

\"NYTimes<\/a>

NYTimes Topics<\/p><\/div><\/p>\n

Ed Summers did some scraping<\/a> while also asking the Open NYTimes team for a SKOS version. Meanwhile, I’m playing around with the classification (online and scraped). Its quirks seem to reflect how it’s been used, and how it has evolved over time. Classification systems can highlight the material classified; they also tend to give insight into the worldview of the people classifying materials or creating the system. The interplay makes integration of classification systems, such as through topic maps<\/a>, an interesting research area. But that’s a topic for another day.<\/p>\n

Here are some things I’ve noticed while playing around with the vocabulary.<\/p>\n

Overall Structure<\/h3>\n

The NYTimes’ main navigation lists 15 sections. The NYTimes taxonomy has 3 top-level categories: news<\/strong>, opinion<\/strong>, and reference<\/strong>. 7 sections fit within the news taxonomy. Opinion has its own category. Travel is an explicit subject within the reference category. Technology, arts, and style are topical, drawing primarily on the reference category. (Cooking, however, is similar to travel in its treatment.) The 3 advertising sections (jobs, real estate, and auto) are already classified, and thus, out of scope.<\/p>\n

The remaining 7 sections we dub “news”. Here are examples of taxonomy terms, showing the category structure:<\/p>\n

News<\/h4>\n
    \n
  1. World<\/strong>: international\/countriesandterritories
    \n     http:\/\/topics.nytimes.com\/top\/news\/international\/countriesandterritories<\/strong>\/canada<\/a><\/li>\n
  2. U.S.<\/strong>: national\/usstatesterritoriesandpossessions\/
    \n    http:\/\/topics.nytimes.com\/top\/news\/national\/usstatesterritoriesandpossessions\/<\/strong>michigan<\/a><\/li>\n
  3. N.Y. \/ Region<\/strong>: newyork, newyorkregion
    \nhttp:\/\/topics.nytimes.com\/top\/news\/newyorkandregion<\/strong>\/columns\/lens\/<\/a>
    \n    http:\/\/topics.nytimes.com\/top\/news\/nyregion<\/strong>\/columns\/clydehaberman\/<\/a>
    \nnyregion<\/strong> and newyorkandregion<\/strong> are both used, but they are not interchangeable (in the sense that there aren’t redirects)
    \n<\/a><\/li>\n
  4. Business<\/strong>: business\/companies
    \n    http:\/\/topics.nytimes.com\/top\/news\/business\/companies<\/strong>\/spicy-pickle-franchising-inc<\/a><\/li>\n
  5. Science<\/strong>: science\/topics
    \n    http:\/\/topics.nytimes.com\/top\/news\/science\/topics<\/strong>\/quasars<\/a>
    \n
    \n<\/strong><\/li>\n
  6. Health<\/strong>: health\/diseasesconditionsandhealthtopics
    \n    http:\/\/topics.nytimes.com\/top\/news\/health\/diseasesconditionsandhealthtopics<\/strong>\/amnesia<\/a>
    \nAs the name (diseases, conditions, health topics) suggests, this encompasses a wide range of topics: particular drugs such as Ritalin, categories of drugs such as antibiotics, topics such as smoking, sleep, teenage pregancy, and twins, and professional groups such as surgery and surgeons.<\/li>\n
  7. Sports<\/strong>: sports, olympics
    \n    http:\/\/topics.nytimes.com\/top\/news\/sports\/baseball\/majorleague<\/em><\/strong>\/philadelphiaphillies<\/a>
    \nhttp:\/\/topics.nytimes.com\/top\/news\/sports\/probasketball\/nationalbasketballassociation<\/em><\/strong>\/atlantahawks<\/a>
    \nBeyond sports<\/strong>, subcategory names vary considerably. Other sections, such as for the Olympics, are outside the main hierarchy:
    \nhttp:\/\/topics.nytimes.com\/olympics\/2008<\/em><\/strong>\/swimming<\/a><\/li>\n<\/ol>\n

    Opinion: opinion<\/span><\/h4>\n

    http:\/\/topics.nytimes.com\/top\/opinion\/editorialsandoped\/oped\/columnists<\/em><\/strong>\/bobherbert<\/a>
    \n    http:\/\/topics.nytimes.com\/top\/opinion\/thepubliceditor<\/strong>\/calame<\/a>
    \nAgain, beyond opinion<\/strong>, there is variation. However, editiorialsandoped<\/em> is the main subcategory.<\/p>\n

    Reference: reference<\/span><\/h4>\n

    http:\/\/topics.nytimes.com\/top\/reference\/timestopics\/organizations\/m<\/em><\/strong>\/mozilla_foundation<\/a>
    \n
    \nhttp:\/\/topics.nytimes.com\/top\/reference\/timestopics\/subjects\/s<\/em><\/strong>\/swimming<\/a>
    \nTravel<\/strong> is handled as a subject:     http:\/\/topics.nytimes.com\/top\/reference\/timestopics\/subjects\/t<\/em><\/strong>\/travel_and_vacations<\/a><\/p>\n

    Spelling Discrepancies<\/h3>\n

    Drugs (Pharmaceuticals) has two spellings: drugs_pharmaceuticals<\/a> and drugspharmaceuticals<\/a> are aliases.<\/p>\n

    E TRADE Financial Corporation<\/a> and E*Trade Financial Corporation<\/a>, however, appears to be an error: they have some data in common, and other data not in common. Either an error or a bizarre story behind that.<\/p>\n

    Differences in usage<\/h3>\n

    Where to put recipes<\/h4>\n

    Apples is a subcategory of cooking (e.g. apples):
    \nhttp:\/\/topics.nytimes.com\/top\/reference\/timestopics\/subjects\/c\/cooking_and_cookbooks\/apples<\/a>
    \nPerhaps because apples tend to be used as a cultural reference? Still, where do apple recipes belong?<\/p>\n

    Pumpkins, on the other hand,\u00a0 has a subcategory for recipes:
    \nhttp:\/\/topics.nytimes.com\/top\/reference\/timestopics\/subjects\/p\/pumpkins\/recipes<\/a><\/p>\n

    Dogs are in science, but fossils are not<\/h4>\n

    While most subjects are classified only alphabetically, there are exceptions. Compare fossils to dogs.
    \nFossils is a plain-old subject, (subjects\/f):
    \nhttp:\/\/topics.nytimes.com\/top\/reference\/timestopics\/subjects\/f\/fossils\/<\/a>
    \nDogs, however, is a science topic, (news\/science\/topics):    http:\/\/topics.nytimes.com\/top\/news\/science\/topics\/dogs\/<\/a>
    \nI wonder if that’s because dogs are a more common subject than fossils?<\/p>\n

    Saying what you mean<\/h4>\n

    Disambiguation, eh? Here, shrimp is a topic within science, so don’t expect recipes (except in the ads):
    \n    http:\/\/topics.nytimes.com\/top\/news\/science\/topics\/shrimp<\/a><\/p>\n

    Category structure<\/h3>\n

    Prominent subtopics<\/h4>\n

    Subtopics are sometimes listed at the top level. For instance United States Attorneys<\/a> seems to contain United States Attorneys: Editorials & Opinion<\/a>. Both are listed at the top of the topics tree.<\/p>\n

    I find it fascinating that Cookies<\/a> and Cookies, Recipes<\/a> are separate topics. Again, culturally justified.<\/p>\n

    Depth of categories<\/h4>\n

    There may be several levels of subcategories, e.g.
    \n<\/a><\/p>\n

    http:\/\/topics.nytimes.com\/top\/news\/science\/topics\/space_shuttle\/atlantis<\/a><\/p>\n

    http:\/\/topics.nytimes.com\/top\/reference\/timestopics\/subjects\/w\/wines\/alsace<\/a><\/p>\n

    Mixing of keyword and controlled terminology<\/strong><\/h3>\n

    I’m surprised to find “hot dogs” as the top two “articles about dogs”, after some nice featured content. NYTimes may also want to refine handling of multiword terms.<\/p>\n

    \"Hot<\/a>

    Hot dogs turn up in dogs<\/p><\/div>\n

    Another example is “Baby Quasar(Skin Care Devise)<\/a>” showing up under quasars<\/a>.<\/p>\n

    By versus About<\/h3>\n

    Times writers (e.g. Tom Zeller Jr.<\/a>) are listed in italics and classified as people. The ‘by’ versus ‘about’ distinction is made primarily in meta tags. “PSST” seems to identify Times writers.For instance, compare the meta tags from Tom Zeller Jr’s page:<\/p>\n

    <meta name=”PT” content=”Topic” \/>
    \n<meta name=”CG” content=”Times Topics” \/>
    \n<meta name=”GTN” content=”Zeller, Tom Jr.” \/>
    \n<meta name=”PST” content=”People” \/>
    \n<meta name=”PSST” content=”Writer” \/><\/p>\n

    to those on (non-Times) writer Toni Morrison’s page<\/a>:<\/p>\n

    <meta name=”PT” content=”Topic” \/>
    \n<meta name=”CG” content=”Times Topics” \/>
    \n<meta name=”GTN” content=”Morrison, Toni” \/>
    \n<meta name=”PST” content=”People” \/>
    \n<meta name=”SCG” content=”The Public Editor” \/><\/p>\n

    Final thoughts<\/h3>\n

    The world of electronic publishing blurs the lines between producers and indexers. Archival content, served up by organization, person, or topic, is a great offering. The secondary publishing market (abstracting, indexing, etc.) is changing quickly. Source-based browsing, as at NYTimes Topics, is part of that change.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Yesterday the NYTimes announced a new API, TimesTags, “based on the taxonomy and controlled vocabulary used by Times indexers since 1851”. The browseable version of this vocabulary, http:\/\/topics.nytimes.com\/ , is a great entry into NYTimes articles published since 1981. Ed Summers did some scraping while also asking the Open NYTimes team for a SKOS version. […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12,4],"tags":[32,29,27,30,31],"class_list":["post-153","post","type-post","status-publish","format-standard","hentry","category-old-newspapers","category-reviews","tag-browsing","tag-classification","tag-nytimes","tag-tagging","tag-taxonomies"],"_links":{"self":[{"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/posts\/153","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/comments?post=153"}],"version-history":[{"count":20,"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/posts\/153\/revisions"}],"predecessor-version":[{"id":174,"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/posts\/153\/revisions\/174"}],"wp:attachment":[{"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/media?parent=153"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/categories?post=153"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jodischneider.com\/blog\/wp-json\/wp\/v2\/tags?post=153"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}