本指南介紹了如何在使用 NewsDataHub API 時對結(jié)果進(jìn)行分頁。

NewsDataHub API 是一項通過 RESTful API 接口提供新聞數(shù)據(jù)的服務(wù)。它實現(xiàn)基于光標(biāo)的分頁以有效處理大型數(shù)據(jù)集，允許開發(fā)人員以可管理的批次檢索新聞文章。每個響應(yīng)都包含一組文章，其中每個文章對象包含標(biāo)題、描述、發(fā)布日期、來源、內(nèi)容、關(guān)鍵字、主題和情緒分析等詳細(xì)信息。該 API 使用光標(biāo)參數(shù)在結(jié)果中進(jìn)行無縫導(dǎo)航，并為搜索參數(shù)和過濾選項等高級功能提供全面的文檔。

有關(guān)文檔，請訪問：https://newsdatahub.com/docs

API 通常在其響應(yīng)中返回有限數(shù)量的數(shù)據(jù)，因為在單個請求中返回所有結(jié)果通常是不切實際的。相反，他們使用分頁——一種將數(shù)據(jù)分成單獨的頁面或批次的技術(shù)。這允許客戶端一次檢索一頁，訪問結(jié)果的可管理子集。

當(dāng)您向 /news 端點發(fā)出初始請求并收到第一批結(jié)果時，響應(yīng)的形狀如下所示：

{
    "next_cursor": "VW93MzoqpzM0MzgzMQpqwDAwMDQ5LjA6MzA0NTM0Mjk1T0xHag==",
        "total_results": 910310,
        "per_page": 10,
        "data": [
            {
                "id": "4927167e-93f3-45d2-9c53-f1b8cdf2888f",
                "title": "Jail time for wage theft: New laws start January",
                "source_title": "Dynamic Business",
                "source_link": "https://dynamicbusiness.com",
                "article_link": "https://dynamicbusiness.com/topics/news/jail-time-for-wage-theft-new-laws-start-january.html",
                "keywords": [
                    "wage theft",
                    "criminalisation of wage theft",
                    "Australian businesses",
                    "payroll errors",
                    "underpayment laws"
                ],
                "topics": [
                    "law",
                    "employment",
                    "economy"
                ],
                "description": "Starting January 2025, deliberate wage theft will come with serious consequences for employers in Australia.",
                "pub_date": "2024-12-17T07:15:00",
                "creator": null,
                "content": "The criminalisation of wage theft from January 2025 will be a wake-up call for all Australian businesses. While deliberate underpayment has rightly drawn scrutiny, our research reveals that accidental payroll errors are alarmingly common, affecting nearly 60% of companies in the past two years. Matt Loop, VP and Head of Asia at Rippling Starting January 1, 2025, Australias workplace compliance landscape will change dramatically. Employers who deliberately underpay employees could face fines as high as AU. 25 million or up to 10 years in prison under new amendments to the Fair Work Act 2009 likely. Employers must act decisively to ensure compliance, as ignorance or unintentional errors wont shield them from civil or criminal consequences. Matt Loop, VP and Head of Asia at Rippling, says: The criminalisation of wage theft from January 2025 will be a wake-up call for all Australian businesses. While deliberate underpayment has rightly drawn scrutiny, our research reveals that accidental payroll errors are alarmingly common, affecting nearly 60% of companies in the past two years. Adding to the challenge, many SMEs still rely on fragmented, siloed systems to manage payroll. This not only complicates operations but significantly increases the risk of errors heightening the potential for non-compliance under the new laws. The urgency for businesses to modernise their approach cannot be overstated. Technology offers a practical solution, helping to streamline and automate processes, reduce human error, and ensure compliance. But this is about more than just avoiding penalties. Accurate and timely pay builds trust with employees, strengthens workplace morale, and fosters accountability. The message is clear: wage theft isnt just a financial risk anymoreits a criminal offense. Now is the time to ensure your business complies with Australias new workplace laws. Keep up to date with our stories on LinkedIn, Twitter, Facebook and Instagram.",
                "media_url": "https://backend.dynamicbusiness.com/wp-content/uploads/2024/12/db-3-4.jpg",
                "media_type": "image/jpeg",
                "media_description": null,
                "media_credit": null,
                "media_thumbnail": null,
                "language": "en",
                "sentiment": {
                    "pos": 0.083,
                    "neg": 0.12,
                    "neu": 0.796
                }
            },
        // more article objects
      ]
  }

注意 JSON 響應(yīng)中的第一個屬性 - next_cursor。 next_cursor 中的值指向下一頁結(jié)果的開頭。當(dāng)發(fā)出下一個請求時，您可以像這樣指定游標(biāo)查詢參數(shù)：

https://api.newsdatahub.com/v1/news?cursor=VW93MzoqpzM0MzgzMQpqwDAwMDQ5LjA6MzA0NTM0Mjk1T0xHag==

嘗試對結(jié)果進(jìn)行分頁的最簡單方法是通過 Postman 或類似工具。這是一個簡短的視頻，演示了如何使用光標(biāo)值在 Postman 中對結(jié)果進(jìn)行分頁。

https://youtu.be/G7kkTwCPtCE

當(dāng) next_cursor 值為 null 時，表示您已到達(dá)所選條件的可用結(jié)果的末尾。

使用 Python 對結(jié)果進(jìn)行分頁

以下是如何使用 Python 通過 NewsDataHub API 結(jié)果設(shè)置基本分頁。

import requests

# Make sure to keep your API keys secure
# Use environment variables instead of hardcoding
API_KEY = 'your_api_key'
BASE_URL = 'https://api.newsdatahub.com/v1/news'

headers = {
    'X-Api-Key': API_KEY,
    'Accept': 'application/json',
    'User-Agent': 'Mozilla/5.0 Chrome/83.0.4103.97 Safari/537.36'
}

params = {}
cursor = None

# Limit to 5 pages to avoid rate limiting while demonstrating pagination

for _ in range(5):
    params['cursor'] = cursor

    try:
        response = requests.get(BASE_URL, headers=headers, params=params)
        response.raise_for_status()
        data = response.json()
    except (requests.HTTPError, ValueError) as e:
        print(f"There was an error when making the request: {e}")
        continue

    cursor = data.get('next_cursor')

    for article in data.get('data', []):
        print(article['title'])

    if cursor is None:
        print("No more results")
        break

基于索引的分頁

一些 API 使用基于索引的分頁將結(jié)果分割成離散的塊。通過這種方法，API 返回特定的數(shù)據(jù)頁，類似于書中的目錄，其中每個頁碼都指向特定的部分。

雖然基于索引的分頁實現(xiàn)起來更簡單，但它有幾個缺點。它難以實時更新，可能會產(chǎn)生不一致的結(jié)果，并且會給數(shù)據(jù)庫帶來更大的壓力，因為檢索每個新頁面需要順序掃描以前的記錄。

我們已經(jīng)介紹了 NewsDataHub API 中基于游標(biāo)的分頁的基礎(chǔ)知識。有關(guān)搜索參數(shù)和過濾選項等高級功能，請參閱完整的 API 文檔：https://newsdatahub.com/docs。

以上是使用 NewsDataHub API 了解分頁的詳細(xì)內(nèi)容。更多信息請關(guān)注PHP中文網(wǎng)其他相關(guān)文章！