A global leader in advanced materials is dedicated to improving the quality of their entry-level manufacturing workforce. This organization partnered with Talogy to implement an in-depth, high-tech selection assessment system, for entry-level production and skilled trades positions at its performance alloy plants. Its goal was to improve the safety and performance of its workforce.
The organization implemented our manufacturing solution (formerly known as Select Assessment® for Manufacturing (SAM)), an in-depth online assessment that measures the key competencies for success in a manufacturing environment. In the years since the implementation, Talogy has implemented many improvements to the assessment which prompted the organization to make the decision to switch to a more enhanced version. The newest version of the assessment was built to maximize validity and increase candidate engagement while shortening the assessment and reducing technical requirements. The changes were right in line with the needs of the organization and it decided to conduct a validation study with the newest version to improve its selection process.
To evaluate the effectiveness of the assessment, a concurrent validation study was conducted to determine the relationship between the assessment tool and key organizational outcomes. 226 current employees, some production and some skilled trades, completed the new assessment. Supervisors provided job performance ratings and safety incident information on the same individuals. The assessment scores were compared to the key outcomes variables and the results show strong evidence that the new assessment provides great value in predicting employee performance and safety-related outcomes.
The Talogy manufacturing solution overall scores were linked to supervisor job performance ratings. In the graphs below, the average performance percentile was calculated for the top and bottom assessment performers. A percentile below 50 means below average, a percentile at 50 is average, and percentiles above 50 are above average. In the case of overall performance, production employees who scored in the lowest 20 percent on the assessment are in the 38th percentile on performance, too. Skilled trades are in the 33rd percentile. These are far below average performers on the job. Alternatively, high scorers are all above average performers – 59th percentile for production and 64th percentile for skilled trades.
Similar patterns are seen with reports of safety related incidents and supervisor ratings of promotability. Top assessment scorers are involved in far fewer safety incidents. Due to the low frequency of safety incidents, we used top and bottom 30 percent for this analysis. The graphs show that a lower percentage of top assessment scorers are involved in at least one safety incident. In the case of skilled trades workers, where they are exposed to more safety hazards, the top scorers were more than three times less likely to be involved in an incident.
Additionally, top assessment scorers are much more likely to be recommended for promotion. When supervisors were asked if the employee would be recommended for promotion, 73 percent of top scoring production employees and 75 percent of top scoring skilled trades employees would be recommended. Only 33 percent and 48 percent of low scoring employees would be considered. Once again, the assessment is able to clearly identify the highest caliber employees in the organization.
For this organization, the updated Talogy manufacturing solution accurately identifies high performing and safe individuals in the entry-level production and skilled trades positions. This assessment will aid this organization in improving the quality of manufacturing workforce by boosting performance and reducing safety risk. And, they can do this while simultaneously reducing their time to hire and improving the candidate experience!
