google_ml_vision

Description:

google ml vision

Google ML Kit Vision Plugin #
(https://pub.dev/packages/google_ml_vision)
A Flutter plugin to use the capabilities of on-device Google ML Kit Vision APIs
Usage #
To use this plugin, add google_ml_vision as a dependency in your pubspec.yaml file.
Using an ML Vision Detector #
1. Create a GoogleVisionImage. #
Create a GoogleVisionImage object from your image. To create a GoogleVisionImage from an image File object:
final File imageFile = getImageFile();
final GoogleVisionImage visionImage = GoogleVisionImage.fromFile(imageFile);
copied to clipboard
2. Create an instance of a detector. #
final BarcodeDetector barcodeDetector = GoogleVision.instance.barcodeDetector();
final FaceDetector faceDetector = GoogleVision.instance.faceDetector();
final ImageLabeler labeler = GoogleVision.instance.imageLabeler();
final TextRecognizer textRecognizer = GoogleVision.instance.textRecognizer();
copied to clipboard
You can also configure all detectors, except TextRecognizer, with desired options.
final ImageLabeler labeler = GoogleVision.instance.imageLabeler(
ImageLabelerOptions(confidenceThreshold: 0.75),
);
copied to clipboard
3. Call detectInImage() or processImage() with visionImage. #
final List<Barcode> barcodes = await barcodeDetector.detectInImage(visionImage);
final List<Face> faces = await faceDetector.processImage(visionImage);
final List<ImageLabel> labels = await labeler.processImage(visionImage);
final VisionText visionText = await textRecognizer.processImage(visionImage);
copied to clipboard
4. Extract data. #
a. Extract barcodes.
for (Barcode barcode in barcodes) {
final Rectangle<int> boundingBox = barcode.boundingBox;
final List<Point<int>> cornerPoints = barcode.cornerPoints;

final String rawValue = barcode.rawValue;

final BarcodeValueType valueType = barcode.valueType;

// See API reference for complete list of supported types
switch (valueType) {
case BarcodeValueType.wifi:
final String ssid = barcode.wifi.ssid;
final String password = barcode.wifi.password;
final BarcodeWiFiEncryptionType type = barcode.wifi.encryptionType;
break;
case BarcodeValueType.url:
final String title = barcode.url.title;
final String url = barcode.url.url;
break;
}
}
copied to clipboard
b. Extract faces.
for (Face face in faces) {
final Rectangle<int> boundingBox = face.boundingBox;

final double rotY = face.headEulerAngleY; // Head is rotated to the right rotY degrees
final double rotZ = face.headEulerAngleZ; // Head is tilted sideways rotZ degrees

// If landmark detection was enabled with FaceDetectorOptions (mouth, ears,
// eyes, cheeks, and nose available):
final FaceLandmark leftEar = face.getLandmark(FaceLandmarkType.leftEar);
if (leftEar != null) {
final Point<double> leftEarPos = leftEar.position;
}

// If classification was enabled with FaceDetectorOptions:
if (face.smilingProbability != null) {
final double smileProb = face.smilingProbability;
}

// If face tracking was enabled with FaceDetectorOptions:
if (face.trackingId != null) {
final int id = face.trackingId;
}
}
copied to clipboard
c. Extract labels.
for (ImageLabel label in labels) {
final String text = label.text;
final String entityId = label.entityId;
final double confidence = label.confidence;
}
copied to clipboard
d. Extract text.
String text = visionText.text;
for (TextBlock block in visionText.blocks) {
final Rect boundingBox = block.boundingBox;
final List<Offset> cornerPoints = block.cornerPoints;
final String text = block.text;
final List<RecognizedLanguage> languages = block.recognizedLanguages;

for (TextLine line in block.lines) {
// Same getters as TextBlock
for (TextElement element in line.elements) {
// Same getters as TextBlock
}
}
}
copied to clipboard
5. Release resources with close(). #
barcodeDetector.close();
faceDetector.close();
labeler.close();
textRecognizer.close();
copied to clipboard
Getting Started #
See the example directory for a complete sample app using Google Machine Learning.