Change language
Python.Engineering Wiki Implementation of the DBSCAN algorithm using Sklearn

Implementation of the DBSCAN algorithm using Sklearn

Python functions
Michael Zippo Michael Zippo 18.07.2021

Dense Spatial clustering of applications with noise ( DBCSAN ) — this is a clustering algorithm that was proposed in 1996. In 2014, the algorithm was awarded the "Test of Time" award at the leading Data Mining conference, KDD.

Dataset — Credit Card .

Step 1: Import Required Libraries

import numpy as np

import pandas as pd

import matplotlib.pyplot as plt

 

from sklearn.cluster import DBSCAN

from sklearn.preprocessing import StandardScaler

from sklearn.preprocessing import normalize

from sklearn.decomposition import PCA

Step 2: Load data

X = pd.read_csv ( ’..input_path / CC_GENERAL.csv’ )

 
# Remove the CUST_ID column from the data

X = X.drop ( ’ CUST_ID’ , axis = 1 )

 
# Handling missing values ​​

X.fillna (method = ’ffill’ , inplace = True )

  

print (X.head ())

Step 3: Data preprocessing

# Scale data to bring all attributes to comparable level

scaler = StandardScaler ()

X_scaled = scaler.fit_transform (X)

 
# Normalize data so that
# data is roughly Gaussian

X_normalized = normalize (X_scaled)

  
# Convert numpy array to panda DataFrame

X_normalized = pd.DataFrame (X_normalized)

Step 4: Downsizing the data to make it renderable

pca = PCA (n_components = 2 )

X_principal = pca.fit_transform (X_normalized)

X_principal = pd.DataFrame (X_principal)

X_principal.columns = [ ’P1’ , ’ P2’ ]

print (X_principal.head ())

Step 5: Building the clustering model

# Numpy array of all cluster labels assigned each data point

db_default = DBSCAN ( eps = 0.0375 , min_samples = 3 ). fit (X_principal)

labels = db_default.labels_

Step 6: Visualize clustering

# Create a label for color matching

colors = {}

colors [ 0 ] = ’r’

colors [ 1 ] = ’g’

colors [ 2 ] = ’b’

colors [ - 1 ] = ’ k’

 
# Build a color vector for each data point

cvec = [colors [label] for label in labels]

  
# To build a legend about the plot

r = plt.scatter (X_principal [ ’P1’ ], X_principal [ ’P2’ ], color = ’ r’ );

g = plt.scatter (X_principal [ ’P1’ ], X_principal [ ’ P2’ ], color = ’g’ );

b = plt.scatter (X_principal [ ’P1’ ], X_principal [ ’ P2’ ], color = ’b’ );

k = plt.scatter (X_principal [ ’P1’ ], X_principal [ ’ P2’ ], color = ’k’ );

 
# P1 plotting on the X axis and P2 on the Y axis
# according to a specific color vector

plt.figure (figsize = ( 9 , 9 ))

plt.scatter (X_principal [ ’P1’ ], X_principal [ ’ P2’ ], c = cvec)

 
# Building a legend

plt.legend ((r , g, b, k), ( ’Label 0’ , ’Label 1’ , ’Label 2’ , ’ Label -1’ ))

  
plt.show ()

Step 7: Setting Model Parameters

db = DBSCAN (eps = 0.0375 , min_samples = 50 ). fit (X_principal)

labels1 = db.labels _

Step 8: Visualize the changes

colors1 = {}

colors1 [ 0 ] = ’r’

colors1 [ 1 ] = ’g’

colors1 [ 2 ] = ’b’

colors1 [ 3 ] = ’c’

colors1 [ 4 ] = ’y’

colors1 [ 5 ] = ’m’

colors1 [ - 1 ] = ’k’

  

cvec = [colors1 [label] for label in labels]

colors = [ ’r’ , ’g’ , ’ b’ , ’c’ , ’y’ , ’ m’ , ’ k’ ]

  

r = plt.scatter (

X_principal [ ’P1’ ], X_principal [ ’P2’ ], marker = ’o’ , color = colors [ 0 ])

g = plt.scatter (

X_principal [ ’P1’ ], X_principal [ ’ P2’ ], marker = ’o’ , color = colors [ 1 ])

b = plt.scatter (

  X_principal [ ’ P1’ ], X_principal [ ’P2’ ], marker = ’ o’ , color = colors [ 2 ])

c = plt.scatter (

X_principal [ ’P1’ ], X_principal [ ’ P2’ ], marker = ’o’ , color = colors [ 3 ])

y = plt.scatter (

  X_principal [ ’ P1’ ], X_principal [ ’P2’ ], marker = ’ o’ , color = colors [ 4 ])

m = plt.scatter (

X_principal [ ’P1’ ], X_principal [ ’P2’ ], marker = ’o’ , color = colors [ 5 ])

k = plt.scatter (

  X_principal [ ’ P1’ ], X_principal [ ’P2’ ], marker = ’o’ , color = colors [ 6 ])

 

plt.figure (figsize = ( 9 , 9 ))

plt.scatter (X_principal [ ’P1’ ], X_principal [ ’ P2’ ], c = cvec)

plt.legend (( r, g, b, c, y, m, k),

( ’Label 0’ , ’ Label 1’ , ’Label 2’ , ’ Label 3 ’ Label 4 ’,

’Label 5’ , ’ Label -1’ ),

scatterpoints = 1 ,

loc = ’upper left’ ,

  ncol = 3 ,

  fontsize = 8 )

plt.show ()

Shop

Gifts for programmers

Learn programming in R: courses

$FREE
Gifts for programmers

Best Python online courses for 2022

$FREE
Gifts for programmers

Best laptop for Fortnite

$399+
Gifts for programmers

Best laptop for Excel

$
Gifts for programmers

Best laptop for Solidworks

$399+
Gifts for programmers

Best laptop for Roblox

$399+
Gifts for programmers

Best computer for crypto mining

$499+
Gifts for programmers

Best laptop for Sims 4

$

Latest questions

PythonStackOverflow

Common xlabel/ylabel for matplotlib subplots

1947 answers

PythonStackOverflow

Check if one list is a subset of another in Python

1173 answers

PythonStackOverflow

How to specify multiple return types using type-hints

1002 answers

PythonStackOverflow

Printing words vertically in Python

909 answers

PythonStackOverflow

Python Extract words from a given string

798 answers

PythonStackOverflow

Why do I get "Pickle - EOFError: Ran out of input" reading an empty file?

606 answers

PythonStackOverflow

Python os.path.join () method

384 answers

PythonStackOverflow

Flake8: Ignore specific warning for entire file

360 answers

All questions

News

24/03/2023 Why do Startups use BVI for incorporation 24/03/2023 GitHub reported github.com RSA SSH key changes after private key leaked to public 24/03/2023 Child spent over $800 in Roblox after bypassing password reset

Wiki

Python functions

Python | How to copy data from one Excel sheet to another

__main__ Python module

Common xlabel/ylabel for matplotlib subplots

ast Python module

Check if one list is a subset of another in Python

code Python module

How to specify multiple return types using type-hints

__main__ Python module

Printing words vertically in Python

code Python module

Python Extract words from a given string

Python functions

Cyclic redundancy check in Python

Python functions

Finding mean, median, mode in Python without libraries

ast Python module

Python add suffix / add prefix to strings in a list

ast Python module

Why do I get "Pickle - EOFError: Ran out of input" reading an empty file?

Python functions

Python - Move item to the end of the list

Python functions

Python - Print list vertically