Cyril Diane (), French artist, designer, programmer and experimenter in the field of user interaction interfaces, application prototype , which uses augmented reality technologies to transfer images from the real world to a graphics editor. The program allows using a mobile phone to take a picture of any real object with the desired angle, after which the application will remove the background and leave only this object. Further, the user can focus the mobile phone camera on the computer screen with a running graphics editor, select a point and insert the object at this position.
Code in Python, and for the Android platform in TypeScript using the React Native framework. To highlight a subject in a photo and clear the background machine learning library , using PyTorch and torchvision. To determine the point on the screen that the phone's camera was aimed at when inserting an object, OpenCV package and class . To interact with the graphic editor, a simple server handler is launched on the system, which transmits an image for insertion at certain X and Y coordinates on the screen (only the Photoshop remote control protocol is currently supported, and support for other graphic editors is promised to be added in the future).
Source: opennet.ru