Technical notes

This page contains information relevant to both the Online Services Report (OSR) and national Key Performance Indicators (nKPI) collections. Further information specific to each collection is provided in Interpreting OSR data and Interpreting nKPI data.

Where to go for more information

This page contains general information to aid interpretation of the OSR and nKPI collections. This should be used in conjunction with additional information contained in the:

In both collections, a client may attend more than one organisation. The extent to which this occurs is not known and is not adjusted for.

While some organisations constitute an individual health care clinic, others have multiple clinics, and provide combined data for all their clinics. Other organisations are intermediaries (for example, Primary Health Networks), which might also combine the data for the clinics where they subcontract services.

Aboriginal Community Controlled Health Organisations (ACCHOs) report all activity (regardless of funding source). Non-ACCHOs should only report activity funded under the Indigenous Australians Health Programme (IAHP) but some report all activity. The extent to which this occurs is not known and may vary by period.

In this report, unless otherwise noted, data from the small number of organisations that received funding only to provide maternal and child health programs or services are included in nKPI data but are excluded from OSR data. These organisations should report only on funded activity and are primarily non-ACCHOs. For more information see Interpreting OSR data and Interpreting nKPI data.

Data collection and submission

Each organisation reporting to the OSR and nKPI collections records service provision in their clinical information systems (CIS). While CIS contain many variables related to individual clients, only those specified as required for the OSR and nKPI collections, aggregated for each organisation, are extracted for use.

Data are aggregated using cohort definitions and specialised software and then submitted to the Australian Institute of Health and Welfare (AIHW) via the Health Data Portal (the HDP). The HDP is the Department of Health and Aged Care’s secure web-based data submission platform.

Most CIS used by First Nations-specific primary health care organisations are able to extract, aggregate and upload the de-individualised data directly to the HDP through a direct-load process. Organisations with systems unable to complete the direct-load process can manually enter aggregate data directly into a web-based form through the HDP.

The HDP applies a series of pre-defined validation rules (originally developed by the AIHW) to the data to identify any data quality issues, for example, that the numerator is less than the denominator, that the numerator sums to the denominator and that related indicators or questions are consistent. In addition, the data are compared with data from the previous period and:

  • for the OSR collection, differences of more than 20% are flagged
  • for the nKPI collection, differences of 25% to 100% are flagged, depending on the size of the numerator/denominator.

If any validation rules are triggered, the organisation is asked to review their data and either amend it, or confirm that it is correct and provide a comment.

The data are then submitted to the AIHW for review. Where the AIHW identifies possible errors or inconsistencies in the data, a comment is added to the HDP containing a description of the issue and the organisation is invited to resubmit their data. This process is repeated until no data quality issues are identified, the relevant organisation indicates it is unable or unwilling to resupply corrected data or the collection period is closed. At this point, the data are considered to be finalised for that organisation.

Where unresolved data quality issues are identified, the AIHW excludes these data from national reporting (this may be a single data item for an organisation or all data for an organisation).

Comparisons over time

Data and trends over time are presented where possible, noting that the organisations reporting to the OSR and nKPI collections, and data quality, can vary over time. For example:

  • While for the most part, it is the same organisations contributing to the collections, as a result of changes in funding, auspicing or reporting arrangements at the local level:
    • the organisations that are funded to provide services vary between periods
    • the funded organisations that are in-scope to report data vary between periods, for example, an organisation may be given an exemption from reporting for a specific period(s).
  • Some organisations may be unable to report accurate data in particular periods or for particular data items (for example, because of changes in their CIS or record-keeping practices) and these data are excluded from national reporting. As such, the number of organisations submitting valid data, on the whole or for a particular data item, vary between periods.
  • The impact of the COVID-19 pandemic, including associated changes in reporting requirements. For example, reporting for periods in 2019–20 and 2020–21 was made voluntary in acknowledgement of the additional pressures on organisations because of COVID-19 and there was an associated decrease in the number of organisations reporting in those periods. COVID-19 also affected the organisations reporting to the collections in a variety of other ways. For more information see Related material and Australia’s Health 2022.

See also the Data Quality Statements for each collection in METEOR.

Estimated resident population (ERP)

The estimated resident population (ERP) used as comparison for the OSR and nKPI client cohorts varies. The ERP chosen, or calculated, for each period is determined based on what is considered to be the most representative population for that period.

As the nKPI collection is based on census dates at 30 June and 31 December each year, the most appropriate ERP to use for comparison with First Nations regular clients is the ERP at the same date as the census date.

As the OSR collection covers a financial year, and estimates as at 30 June not considered appropriate for use when calculating rates based on financial year data, estimates for 31 December (that is, the midpoint of the financial year) are needed.

While the Australian Bureau of Statistics (ABS) produces estimates for the overall Australian population for 2 time points each year – namely, as at 30 June and 31 December – they only produce estimates for the First Nations population as at 30 June. As such, ERP at 31 December are calculated by averaging the June population estimates before and after the relevant December. For example, 31 December 2020 estimate = (30 June 2020 estimate + 30 June 2021 estimate)/2.

Rounding

Numbers presented in tables and visualisations are unrounded.

The number of organisations presented in text are unrounded. All other numbers presented in text are rounded, according to the following rules:

  • millions are rounded to one decimal place and written with a number and a word, for example, 10.2 million
  • numbers over 100,000 and under a million are rounded to the nearest multiple of 1,000
  • numbers between 1,000 and 100,000 are rounded to the nearest multiple of 100
  • numbers between 500 and 999 are rounded to the nearest multiple of 10
  • numbers between 100 and 499 are rounded to the nearest multiple of 5
  • numbers between 0 and 99 are rounded to the nearest whole number.

Averages and proportions presented in text, tables and visualisations are rounded to one decimal place.