1. Python
  2. How to use the Vision API from Google Cloud | Set-2

How to use the Vision API from Google Cloud | Set-2

Python Methods and Functions

Best laptop for Machine Learning

Raspberry Pi robot kit

Best keyboard for programming

In

import os

import io

from google.cloud import vision

from matplotlib import pyplot as plt

from matplotlib import patches as pch

 

os.environ [ ' GOOGLE_APPLICATION_CREDENTIALS' ] =  

  os.path.join ( (os.curdir, 'credentials.json' )

  

client = vision.ImageAnnotatorClient ()

 

f = 'image_filename.jpg'

with io. open (f, 'rb' ) as image:

  content = image.read ()

  

image = vision. types.Image (content = content)

response = client.text_detection (image = image)

texts = response.text_annotations

 

a = plt.imread (f)

fig, ax = plt.subplots ( 1 )

ax.imshow (a)

 

for text in texts:

print (text.description)

 

vertices = ([(vertex.x, vertex.y) 

for vertex in text.bounding_poly.vertices]) 

  

  print ( 'Vertices covering text: {}' . format (vertices))

rect = pch.Rectangle (vertices [ 0 ], (vertices [ 1 ] [ 0 ] - vertices [ 0 ] [ 0 ]), 

(vertices [ 2 ] [ 1 ] - vertices [ 0 ] [ 1 ]), linewidth = 1 , 

edgecolor = 'r' , facecolor = 'none' ) 

ax.add_patch (rect)

 
plt.show ()

The above code extracts the text from the given image and also prints the coordinates of the vertices of the rectangle containing the text.
For example, when the following image is specified as input:

Output: 

 MY MORNING ROUTINE How Successful People Start Every Day Inspired BENJAMIN SPALL and MICHAEL XANDER Vertices covering text: [(38, 71), (348, 71), (348, 602), (38 , 602)] MY Vertices covering text: [(46, 71), (108, 82), (100, 128), (38, 117)] MORNING Vertices covering text: [(129, 79), (348, 118 ), (338, 170), (120, 131)] ROUTINE Vertices covering text: [(96, 135), (292, 170), (283, 219), (87, 184)] How Vertices covering text: [ (68, 200), (101, 205), (98, 221), (65, 216)] Successful Vertices covering text: [(104, 207), (196, 222), (193, 238), (101 , 224)] People Vertices covering text: [(202, 222), (257, 231), (254, 251), (199, 242)] Start Vertices covering text: [(265, 232), (311, 239 ), (309, 255), (262, 248)] Every Vertices covering text: [(112, 238), (155, 246), (152, 265), (109, 258)] Day Ve rtices covering text: [(160, 246), (189, 251), (185, 271), (157, 266)] Inspired Vertices covering text: [(194, 251), (262, 263), (258, 283), (191, 271)] BENJAMIN Vertices covering text: [(57, 534), (118, 546), (115, 561), (54, 549)] SPALL Vertices covering text: [(122, 550) , (160, 558), (157, 572), (119, 564)] and Vertices covering text: [(165, 560), (185, 564), (182, 577), (162, 573)] MICHAEL Vertices covering text: [(190, 564), (250, 576), (247, 590), (187, 578)] XANDER Vertices covering text: [(254, 575), (311, 587), (308, 602), (251, 591)]

Document / handwriting detection:

This feature also performs OCR on thick documents, including handwritten text.

import os

import io

from google .cloud import vision

from matplotlib import pyplot as plt

 

os.environ [ 'GOOGLE_APPLICATION_CREDENTIALS' ] =  

os.path.join ( (os.curdir, 'credentials.json' )

 

client = vision.ImageAnnotatorClient ()

 

f = 'image_filename.jpg'

with io. open (f, 'rb' ) as image:

  content = image.read ()

 

image = vision.types.Image (content = content)

response = client.document_text_detection (image = image)

 

a = plt.imread (f)

plt.imshow (a)

 

txt = []

for page in response. full_text_annotation.pages:

for block in page.blocks:

print ( 'Confidence: {}%' . format (block.confidence * 100 ))

for paragraph in block.paragraphs:

  

  for word in paragraph.words:

word_text = '' .join ([symbol.text for symbol in word.symbols] )

txt.append (word_text)

 

print (txt)

The above code identifies and extracts handwritten text from an image and outputs it.
For example, when we give the following image as input:

Output: 

 Block confidence: 97.00000286102295% ['Geeks',' for', 'Geeks',' A', 'computer',' science', 'portal',' for', 'Geeks ',' .']

Detect image properties:

This function detects general image attributes such as dominant color.

import os

import io

from google.cloud import vision

from matplotlib import pyplot as plt

 

os.environ [ 'GOOGLE_APPLICATION_CREDENTIALS' ] =

os.path.join ( (os.curdir, 'credentials.json' )

 

client = vision.ImageAnnotatorClient ()

 

f = 'image_filename.jpeg'

with io. open (f, ' rb' ) as image:

content = image.read ()

 

image = vision.types.Image (content = content)

 

response = client.image_properties (image = image)

properties = response.image_properties_annotation

 

a = plt.imread (f)

plt.imshow (a)

 

for color in properties.dominant_colors.colors:

print ( 'fraction: {}' . format (color.pixel_fraction))

print ( ' r: {} ' . format (color.color.red))

print ( 'g: {}' . format (color.color. green))

print ( ' b: {} ' . format (color.color.blue) )

The code takes an image as input and returns its color properties , that is, the amount of red, green, and blue. For example, when the following image is specified as input:

Output: 

 fraction: 0.036332178860902786 r: 5.0 g: 185.0 b: 6.0 fraction: 0.03337658569216728 r: 131.0 g: 207.0 b: 13.0 fraction: 0.029988465830683708 r: 253.0 g: 169.0 b: 5.0 fraction: 0.0262399073690176 r: 254.0 fraction: 0.0262399073690176 r: 254.0 123.0 b: 5.0 fraction: 0.03553921729326248 r: 253.0 g: 248.0 b: 12.0 fraction: 0.02104959636926651 r: 249.0 g: 36.0 b: 6.0 fraction: 0.024581892415881157 r: 3.0 g: 35.0 b: 188.0 fraction: 0.0342416390 g7766342 r: 6.0 fraction: 0.0342416390 g7766342 r: 6.0 : 200.0 fraction: 0.027032872661948204 r: 140.0 g: 32.0 b: 185.0 fraction: 0.029411764815449715 r: 10.0 g: 177.0 b: 217.0

Detect safe search properties:

Detect explicit content like adult content or violent content in the image This feature uses five categories ("adult", "deception", "medical", "violence" and "rude") and in Returns the likelihood that each of them is present in this image.

import os

import io

from google.cloud import vision

from matplotlib import pyplot as plt

 

os.environ [ 'GOOGLE_APPLICATION_CREDENTIALS' ] =  

  os.path.join ( (os.curdir, ' credentials.json' )

 

client = vision.ImageAnnotatorClient ()

  

f = 'image_filename.jpg'

with io. open (f, 'rb' ) as image:

  content = image.read ()

 

image = vision.types.Image (content = content)

 

a = plt.imread (f)

plt.imshow (a)

 

response = client.safe_search_detection (image = image)

safe = response.safe_search_annotation

  

likelihood_name = ( 'UNKNOWN' , ' VERY_UNLIKELY' , 'UNLIKELY' ,

  ' POSSIBLE' , 'LIKELY' , 'VERY_LIKELY' )

  

print ( 'Adult: {}' . format (likelihood_name [safe.adult]))

print ( 'Medical: {}' . format (likelihood_name [safe.medical]))

print ( 'Spoofed: {}' . format (likelihood_name [safe.spoof]))

print ( 'Violence: {}' . format (likelihood_name [safe.violence]))

print ( 'Racy: {}' . format (likelihood_name [safe.racy]))

Given an image, the code will determine the likelihood that it will be an image with graphics or adult content.

Object Detection:

Detects and extracts multiple objects from the image. It localizes multiple objects and returns their coordinates.

import os

import io

from google.cloud import vision

from matplotlib import pyplot as plt

 

os.environ [ 'GOOGLE_APPLICATION_CREDENTIALS' ] =  

  os.path.join ( (os.curdir, 'credentials.json' )

 

client = vision.ImageAnnotatorClient ()

 

f = 'image_filename.jpg'

with io. open (f, 'rb' ) as image:

content = image.read ()

 

image = vision.types.Image ( content = content)

 

a = plt.imread (f)

plt.imshow (a)

 

response = client.object_localization (image = image)

objects = response.localized_object_annotations

 

print ( 'Number of objects found:' , len (objects))

for object_ in objects:

print ( 'Object:' , object_.name)

print ( 'Confidence : ' , object_.score)

For example, when we enter the following image:

Output: 

 Number of objects found: 1 Object: Scissors Confidence: 0.540185272693634

For more information, visit the Cloud Vision API documentation here .





Tutorials



Python OpenCV | cv2.putText () method

numpy.arctan2 () in Python

Python | os.path.realpath () method

Python OpenCV | cv2.circle () method

Python OpenCV | cv2.cvtColor () method

Python - Move item to the end of the list

time.perf_counter () function in Python

Check if one list is a subset of another in Python

Python | os.path.join () method

Python | os.path.expanduser () method

Replace negative value with zero in Numpy array

Python | Convert nested dictionary list to Pandas dataframe

TimeField — Django Models

Python | os.path.isdir () method

Python OpenCV cv2.line () method

numpy.poly1d () in Python

Numpy.sqrt () in Python

Split nested list into two lists in Python

Python program to convert camel case string to snake case

Python | Pandas DataFrame.reset_index ()

Binning in Data Mining

Python | Add suffix / prefix to strings in a list

Dunn index Python

Python - Print list vertically

Books for developers

Python Data Science Handbook

22/08/2021

CEH v11 Certified Ethical Hacker Study Guide

12/08/2021

Data Science from Scratch. First Principles with Python

23/09/2020

Python Workout: 50 TEN-MINUTE EXERCISES

23/09/2020