The UK JISC organisation which supports universities in the development and use of new technologies has also initiated an innovation Laboratory working with data. They are investigating how the huge and diverse sources of data that are now available be better used to address and inform key policy decisions in education and training, in ways that meet both the requirements of national and regional agencies and also the local nuances and concerns of colleges serving immediate communities (Footring, 2017).
The Jisc College Analytics Lab digital modelling environment provides a means to address complex practice and policy questions using highly diverse sources of data. By engaging both with colleges, with their command of the details of learner data, and regional and national planning agencies, that need to aggregate intelligence across wider areas in order to generate policy recommendations.
In particular, Jisc are focusing on local area data to inform strategic planning and decision making. They say “presenting the information in a visual and interactive way helps leaders to communicate their vision and ideas to their funders, staff teams, students and the wider community.” However, they have found is that there is a wide variation in the effectiveness of the way in which colleges make use of the data available to them and a significant duplication of similar core processes across colleges.
The Analytics Lab environment provides a secure technical, legal and project management framework to enable the creation of new, experimental data dashboards. Participants use a mix of open and secure data from both new and established sources, to create visualisations and dashboards which address key business questions.
Since the last post on the future of LMI for All, Robert Halfon (Minster of State for Education) provided a statement to parliament on the future of UKCES. He confirmed that LMI for All will now move to the Department for Education following the reorganisation of the Department for Business Innovation and Skills. We expect the transfer to take place in September.
To cover the period of the transfer and beyond, Warwick Institute for Employment Research (IER) and its partners have been reappointed to provide the LMI for All service. In the year ahead, the existing service will be developed in a number of ways including, improved infrastructure and reliability, new engagement and dissemination activities, and a redeveloped ‘Careerometer’ widget. Data in the API will continue to be refreshed when updates are available. DfE will also take stock of the project and consider its next phase of development.
The UK Commission for Employment and Skills’ (UKCES) LMI for All online data portal will continue to operate under the management of the Department for Business Innovation and Skills (BIS).
UKCES has announced that the running of their LMI (Labour Market Information) for All tool, which gives easy access to labour market data, will be transferred to BIS. This transfer will take place over the next year and allow LMI for All to remain after funding for UKCES is withdrawn.
Peter Glover, Project Manager for LMI for All, said:
“We intend to fulfill our existing plans around data development and refreshment as set out on the LMI for All website. We will also endeavour to ensure that there is continuity of service throughout the transition period.”
LMI for All is a tool which brings together existing sources of high quality, reliable labour market information. It is used by employers, career service providers and individuals to access data which forms the basis of careers advice and business decisions.
It was announced funding would be withdraw from UKCES in the Autumn Statement last year. This means any continuing UKCES products or services will have to be transferred elsewhere.
LMI for All is an online data service, delivered via an API (application programming interface), that provides access to high quality labour market data to third party developers. We want developers to use the data to power applications and websites that help people to make good careers decisions.
LMI for All is providing access to real-time labour market data on a pilot basis from the beginning of January to the end of March 2016. Access is free of charge, subject to terms and conditions (see below). You can get in touch now to register your interest in the data and find out more.
The following document provides answers to key questions relating to the pilot. If you have a query that is not covered below please get in touch via
We are providing access to counts of UK online job postings, classified by occupation (standard occupational classification), industry and location (UK nation, English region, local travel-to-work area).
The counts relate to job postings made in the recent past (e.g. previous 90 days) and the data will be updated on a rolling basis each day to ensure currency.
Why are you providing access to this dataset?
Real-time job postings have enormous potential in the field of labour market intelligence, as an ever-increasing proportion of job openings are posted on the internet. We want to test the benefits of widening access to this kind of analysis, particularly in the context of careers decision making.
We believe that we can achieve a significant “public good” by making the data widely and freely available, particularly since there are currently no official statistics available on the occupational profile of vacancies.
We will use the learning from our pilot to determine whether to roll-out real-time data via LMI for All on an ongoing basis. We will also document and publish our learning for wider consumption.
Why is this dataset useful?
When making a choice about the right career path for them, it’s helpful for an individual to get an impression of the number of opportunities that are currently available for a job or jobs that they are interested in. Is there demand for people who are qualified to do the job? Quite often the individual is focused on a particular geographic area. They may want to know whether they can pursue a particular career in their local area and whether there are sufficient opportunities for them to do so.
Where do the data come from?
The data are being sourced from Burning Glass, a leading supplier of real-time labour market intelligence. Burning Glass are a US-based company who are establishing a strong presence in the UK.
We are interested in other job postings data such as skills required for particular jobs. Why is this not being made available?
The range of data that we can make available through the trial is limited by budget constraints. The more variables we include the more expensive it becomes. If you have an opinion about the data that is most valuable for careers purposes we would like to hear from you.
How can I be sure of the quality of the data?
Burning Glass’ data are compiled from thousands of sources of job postings in the UK, including online job boards and company websites. The data are collected and parsed locally i.e. within the UK and sites are vetted in advance to ensure they are a valid source of job opportunities.
New job postings are identified, processed, and added to the Burning Glass database each day.
Within job postings more than 70 data elements are parsed, extracted and coded including job title which is used to map to an occupation and employer which is used to assign an industry code. Burning Glass use a curated set of tens of thousands of business rules to appropriately assign a job into an occupation.
Robust mechanisms have been put in place to deduplicate job advertisements to ensure that the values presented are based on unique opportunities rather than an aggregation of all posting activity undertaken by recruiting and staffing agencies and other firms.
Are there any restrictions on how we can use the data?
There are additional restrictions placed on the use of this dataset, beyond what is already contained in our standard terms and conditions for LMI for All.
In line with the overall aim of LMI for All, developers (including commercial organisations) may use the data as an input to applications and websites that are designed to support individuals in making choices about careers and learning options. The data may not be used for other commercial purposes e.g. you may not download the data in bulk for resale.
Each organisation will be vetted to ensure that its proposed use of the data is in keeping with the spirit of this objective.
Full terms and conditions will be provided when you apply for access to the data.
How long does the pilot run for and what happens afterwards?
Our current plan is to run a short pilot to from the beginning of January 2016 to 31 March 2016 to gauge demand from third party developers.
Depending on the level of demand and interest we may seek to offer data of this kind on a longer term basis or to extend the duration of the pilot.
In any event, we will not cut off access to the data on the 31 March; it will continue to be available afterwards but it will not be updated on a daily basis.
What do I need to do next?
If you are interested in exploring the dataset and potentially incorporating it into an application or website please email
and we will issue you with a unique passcode.
Who can I contact with technical queries about the API in general or specifically about the real-time data?