What are the challenges for the sector?

1 Inadequate core knowledge and experience across the sector

Many of those institutions and individuals contacted during the research for this project admitted that although they know the outcomes they want and can discuss what successful BI systems will do, they do not fully understand the technology, nor are entirely clear of what processes they will need to undertake to get there.

There is a belief that there is inadequate core knowledge and experience across the sector in the area of BI and a lack of sector leadership here too. Many would like to be able to share and compare with peers, but competition and a hesitation to show ignorance seem to prevent this. As a result a number are paying consultants to help them.

While those who are struggling with their projects seek networking opportunities, one or two that now have working systems are unwilling to share success with 'competitors'.

FE institutions feel further behind in the discussion with little or no opportunities for discussion. There is a lack of collaboration and people are buying off the shelf solutions.

2 Lack of consistent data definitions

Considerable concern was expressed about the lack of onsistent data definitions between external bodies (eg HEFCE & SLC). Some also found that failure to understand data and related questions led to problems with source data and to inconsistency of reporting.

The issue of inconsistent data definitions was also raised as a problem within institutions and also features under the 'Data Definitions' institutional challenge (No. 4).

3 Benchmarking

Institutions reported frustration at the difficulty of comparing KPIs from institution to institution for benchmarking purposes. Most respondents found benchmarking with other institutions almost impossible to do satisfactorily.

Many found HESA's HEIDI a useful tool, but clunky and not user-friendly. All commented on the lack of granularity (beyond institution level) and difficulty of making meaningful comparisons, with at least two institutions paying an external contractor to undertake their KPI and benchmarking work for them as a result.