Machine Learning

What Is Machine Learning?

Understanding Learning Problems Through Credit Card Approval Systems.

V
Vikalp Veer

What is machine learning ?

Machine learning is one of the most transformative ideas in modern computing. Instead of explicitly programming every rule a computer must follow, we allow systems to learn patterns from data and improve their behavior over time.

This article explores:

  • What machine learning actually is
  • What constitutes a learning problem
  • Why learning from data matters
  • How banks use machine learning for credit card approval decisions

The Traditional Programming Approach

Before machine learning, most software systems were built using handcrafted rules.

For example, imagine building a credit card approval system using traditional programming:

if salary > 100000 and credit_score > 750: approve_application() else: reject_application()

At first glance, this seems reasonable.

But real-world decision-making is rarely this simple. What if:

  • The applicant has low salary but excellent repayment history?
  • They recently changed jobs?
  • They have high debt but strong assets?
  • They are young with limited credit history?
  • Fraud patterns evolve over time?

Soon, the rule system becomes enormous, brittle, and difficult to maintain.

This is where machine learning becomes useful.

ℹ️
Definition

Machine learning is the process of using data to improve performance on a task.

Instead of explicitly writing all rules, we provide:

  • Historical data
  • Examples of past outcomes
  • Features describing the problem

The system then discovers patterns automatically.

The Core Idea: Learning From Examples

Imagine a bank has millions of historical credit card applications.

Each application contains information such as:

FeatureExample
Age32
Salary$120,000
Credit score780
Existing debt$15,000
Late payments0
Employment years5
Approved previouslyYes
Defaulted later?No

Now suppose we also know the final outcome:

  • Did the customer repay responsibly?
  • Did they default?
  • Did they become high-risk?

This historical dataset becomes the foundation for learning.

The machine learning model studies past examples and attempts to discover patterns that separate:

  • Good applicants
  • Risky applicants

What Is a Learning Problem?

A learning problem consists of three major components:

ComponentMeaning
Experience (E)Historical data/examples
Task (T)The thing we want to improve
Performance Measure (P)How we evaluate success

A computer program learns from experience E with respect to task T and performance measure P if its performance at T improves with experience E.

Credit Card Approval as a Learning Problem

Let’s map this to the banking example.

  1. Experience (E)

The bank has years of historical applications:

  • Customer demographics
  • Financial history
  • Transaction patterns
  • Loan repayment behavior
  • Fraud reports

This historical dataset is the experience. 2. Task (T)

The task is:

Predict whether a new applicant is likely to be a trustworthy borrower.

The system may output:

  • Approve
  • Reject
  • Manual review required

Or even a probability score:

Probability of default = 0.12
  1. Performance Measure (P) How do we know the system is good? Banks may evaluate:
  • Default prediction accuracy
  • False approvals
  • False rejections
  • Financial loss reduction
  • Fraud detection rate

The model improves if it makes better lending decisions over time.

Why Machine Learning Works Well Here?

Credit risk analysis involves extremely complex relationships.

For example:

  • Younger applicants may be risky in one region but safe in another
  • High debt may be acceptable for high-income applicants
  • Spending behavior may reveal hidden risk patterns
  • Thousands of variables may interact together

Humans cannot easily encode all these relationships manually.

Machine learning systems can uncover subtle statistical patterns from massive datasets.

The Learning Pipeline

A simplified bank ML workflow may look like this:

Customer Application Feature Extraction ML Model Prediction Risk Score Generation Approve / Reject / Manual Review

What Does the Model Actually Learn?

The model does not “understand” humans like people do.

Instead, it learns mathematical relationships.

For example:

  • Applicants with repeated late payments may correlate with default risk
  • Very high utilization ratios may indicate financial stress
  • Stable employment history may correlate with reliability

The model converts these patterns into numerical parameters.

Supervised Learning

The credit card example is a classic case of supervised learning.

In supervised learning:

  • Inputs are known
  • Correct outputs are known
  • The model learns the mapping

Generalization: The Real Goal

A model is not useful if it only memorizes historical applications.

It must perform well on:

  • New customers
  • New market conditions
  • Unseen financial behaviors

The challenge is:

Learn patterns that generalize beyond the training data.

This is the heart of machine learning.

Challenges in Real Banking Systems

Real-world banking ML systems face many challenges.

Imbalanced Data

Most customers repay successfully.

Defaults are rare.

This creates skewed datasets.

Bias and Fairness

Models may unintentionally learn unfair biases from historical data.

Banks must carefully ensure:

  • Regulatory compliance
  • Ethical lending
  • Fair treatment across demographics

Concept Drift

Customer behavior changes over time.

Economic downturns, inflation, or new fraud techniques can make old patterns obsolete.

Models must be retrained continuously.