Skillabi: Program to LOT Matching

Skillabi: Program to LOT Matching

 

Created Date

Oct 31, 2022

Target PI

Targeting Q4-2022, but may run into PI1 of 2023

Target Release

Q4

Jira Epic

https://economicmodeling.atlassian.net/browse/SKL-905

Document Status

Draft

Epic Owner

@Gavin Esser

Stakeholder

 

Engineering Team(s) Involved

Skillabi

Customer/User Job-to-be-Done or Problem

As a Program Owner/Chair/Director, I want to see what unique labor market outcomes my program matches to based on the skills taught so that I can identify new avenues for program growth, confirm strengths, or realign weaknesses.

Value to Customers & Users

  • Insights into skill alignment of education offerings

  • Improved matching of outcomes to programs

  • A broader range of education offerings supported properly

Value to Lightcast

  • Build Trust in Skillabi Data

  • Highlight our proprietary Lightcast Occupation Taxonomy

Target User Role/Client/Client Category

Program Owners/Directors. Additionally this epic supports, to a lesser degree, academic leadership roles, like Deans or Provosts, and Faculty Members.

Delivery Mechanism

This Epic will be delivered in Skillabi. It will happen automatically by implementing our multi-skill LOT model to display top matches for each program in the tool.

Success Criteria & Metrics

  • LOT Occupations are clearly displayed to users in a list of top matches that reflect the best fit for the identified program skills.

  • User sentiment reflects a clear improvement on usability and relevance of results.

    • Measured by VoC work and notes from Sales and Success

  • Increase Benchmark Engagement Retention Over time

    • Baseline: 19% 3 month retention - Target: 35% 3 month retention

Aspects that are out of scope (of this phase)

  • Defining, Distinguishing and Necessary skills included in Market Alignment analysis

  • Removing Skill Clusters functionality from Skillabi

Solution Description

  • Apply the new LOT multi-skill similarity model to programs, generating a list of ranked occupations.

  • Display ranked option to users in the Edit Benchmarks modal in place of current Skill Cluster matches.

  • Retain skill cluster matching for now in a transition period.

Early UX (wireframes or mockups)

UX still to come

Non-Functional Attributes & Usage Projections

Consider performance characteristics, privacy/security implications, required copy translations (mostly surveys), mobile requirements, accessibility requirements

Dependencies

Requires multi-skill to LOT similarity model that works with large numbers of skills found in programs. This can be up to 150 skills or more in some cases.

  • This model has already been built and is currently in final testing

Legal and Ethical Considerations

No

High-Level Rollout Strategies

  • Initial rollout to internal Customer Success and Sales teams in Education to prepare them for the details of the change, timeline for phasing out legacy matches, and how to communicate this with customers.

  • The feature will be released for all users of Skillabi.

    • Coordinate the release of the feature with a Pendo announcement and guide.

  • Monitor feature usage and any feedback from users.

Risks

This model may produce poor results in some instances. This will be mitigated through testing.

Open Questions

  • How long should the transition period be between this Epic release and the release of the subsequent Epic for removing the Skill Cluster functionality?

 


Complete with Engineering Teams

 

Effort Size Estimate

Estimated Costs

Direct Financial Costs

Are there direct costs that this feature entails? Dataset acquisition, server purchasing, software licenses, etc.?

 

Team Effort

Each team involved should give a general t-shirt size estimate of their work involved. As the epic proceeds, they can add a link to the Jira epic/issue associated with their portion of this work.

Team

Effort Estimate (T-shirt sizes)

Jira Link

Team

Effort Estimate (T-shirt sizes)

Jira Link