LenddoEFL — Blog — LenddoEFL

By: Jonathan Winkle, Manager of Behavioral Sciences, LenddoEFL

The last post showed how our psychometric content reveals people’s personality traits, but our assessment also captures an abundance of metadata. Metadata is information about how people process the questions and exercises they complete. Here are some examples.

How long did an applicant take to answer a question compared to their average response time?
How many times did an applicant change their mind and switch their response before submitting their answer?
Is the applicant’s information consistent with their written request to the financial institution? (e.g., requested loan amount)

By measuring metadata, LenddoEFL’s approach goes beyond what is possible in traditional credit applications to reveal more information about applicants. Consider the following question from our test:

Which BLUE person is most like you?

For this question, we consider how long it took the applicant to slide to one answer or another and whether they changed their opinions in the middle. Someone who is confident that they are an organized person should move the slider in only one direction and relatively quickly. Quick, smooth answers belie confidence, whereas slow, wavering responses demonstrate uncertainty.

The relationship between response time and default rate can be complex. Consider another psychometric exercise:

In this case response time was a non-linear predictor of default, where both slow and fast response times were associated with a greater credit risk!

There are many ways to interpret response time metadata. If an applicant answers a question quickly, are they confident or are they cheating? If they are taking a long time to respond, are they having difficulty understanding the question or putting extra effort into getting their answer right? By collecting metadata across all questions, we can compare a single response time to the applicant’s overall response time distribution to differentiate things like confidence and cheating (see graph below).

An example distribution of response times generated from artificial data

Conclusion

Metadata reveals another layer of behavior on top of the personality traits we target and can be used to identify features such as confidence, cheating, and confusion. These behavioral traits can be used for predicting default and ensuring that we are collecting high quality data for our models.

By: Jonathan Winkle, Manager of Behavioral Sciences, LenddoEFL

At LenddoEFL, we collect various forms of alternative data to help lenders verify identities, analyze credit risk, and better understand an individual. One of our most important tools for financial inclusion is our psychometric assessment. While some people still lack a robust digital footprint, everyone has a psychological profile that can be characterized and used for alternative credit scoring.

In this series of posts, we shed light on the science behind the LenddoEFL psychometric assessment and how we’ve pioneered an approach to measure anyone’s creditworthiness.

Psychometrics for credit assessment

LenddoEFL employs a global research team to ensure our assessment captures the most important personality traits that predict default. We deliver innovative psychometric content by combining insights from leading academics with years of in-house research and development.

Each question in our assessment is targeted to reveal psychological attributes related to creditworthiness. We quantify behaviors and attitudes such as individual outlook, self-confidence, conscientiousness, integrity, and financial decision-making in order to build an applicant’s psychometric profile. By comparing this profile to others in the applicant pool, we can better understand and predict an individual’s likelihood of default.

Psychometric example content: Financial Impulsivity

The marshmallow test asks children whether they would you like one marshmallow now or two marshmallows later, and since its advent, psychologists have recognized that the ability to delay rewards is an important predictor of later success in life.

While adults might not long for marshmallows the same way children do, a similar test can be performed using financial rewards, and research shows that people who are better at delaying rewards are less likely to default on their loans.

Drawing from this research, we ask applicants which of two options they would prefer, a smaller sooner amount of money, or a larger later amount (see image below). Asking people for their preferences across a range of monetary values and temporal delays reveals a quantitative profile of their financial impulsivity, which is indicative of their likelihood to repay debts (If you’re curious about how we deal with people trying to cheat or game the assessment, please see this blog post on our Score Confidence algorithm)

Which do you prefer?

Psychometric example content: Locus of Control

When times get tough, some people believe they can take action to overcome hardships while others believe that the challenges they face are altogether out of their hands. Those who believe their lives are governed by outside forces, an external Locus of Control, are more risk-averse and have more difficulty managing their credit.

We ask applicants to rate their agreement with a battery of statements measuring their Locus of Control, such as “My life is mostly controlled by chance events,” and “It is mostly up to luck whether or not I have many friends.” By asking these types of questions, we can precisely quantify someone’s Locus of Control along a spectrum of internal-to-external and use this data to predict default.

Conclusion

LenddoEFL delivers an innovative psychometric assessment by combining evidence from academia with active, internal research and development. The examples above demonstrate how we quantify certain personality traits, and the myriad exercises we use in the field allow us to produce a rich psychological profile that is predictive of credit risk. In the next post we will explore the concept of metadata, which will show that how people answer psychometric questions is just as important as the answers themselves.