deepmediaThe next generation of mobile AR.
DeepMedia is a collection of mobile SDKs designed to deliver rich and beautiful AR experiences to your users, using state-of-the-art technologies based on artifical intelligence.
State of the art AR
We use state-of-the-art technologies to provide augmented reality features to your mobile application and users.
Powered by AI
Our engine leverages deep learning techniques for face detection, background removal and many other tasks.
Real-time
All AR effects are designed to work in real-time on live video streams of all kinds, be it the camera preview, playback or recording.
Battle-tested
Our SDKs are tested on several devices before each release, so that they can be integrated smoothly into existing apps.
DeepEffects SDK
Managed AR effects.
The DeepEffects SDK for mobile devices lets you apply real-time AR effects within your app. It uses machine learning models for scene processing and feature detection, then renders beautiful elements of your choice.
Android
iOS
Accurate 3D detection
Easily detect scene features in real-time, including accurate 3D face meshes, then combine this input with live data from the real world, like the device orientation.
Augmented reality
Apply beautiful effects based on scene features, to enhance or augment the media content with different effects like color filters, stickers and AR elements.
Portable effects
Effects are loaded and played through a single effect file, which can be easily served by your servers, cached on-device and shared between end users.
Multiple inputs
Apply effects on all kinds of graphical inputs, be it live streams, camera previews, video recordings, video playback and image editing interfaces.
DeepEffects Studio
Create effects in-house.
The Studio application is able to create beautiful effects that are shared with your mobile app and played by the DeepEffects SDK. It provides innovative controls to make effect creation easy, even by people with little knowledge of graphic design.
Android
iOS
Mobile first
Develop performant effects for your app directly from your mobile device. No special hardware or knowledge is required.
Intuitive controls
Use intuitive controls to design effects of many kinds. The Studio innovative UI and UX hides away the complexity and lets you focus on what matters.
Save resources
Since every employee can become an effect designer with little to no training, you can save precious time and money during the effect development phase.
Portable effects
AR effects are bundled in a standalone file which can be easily served by your backend, but also shared between designers in your company for iterating.
DeepEffects Creator SDK
Let everyone create.
One step further: the DeepEffects Creator SDK can be implemented within your application to let end users - not your company - design their own AR effects, embracing an emerging trend in mobile applications to unleash user creativity. By using the SDK, you can replicate the Studio app capabilities in your own application.
Android
iOS
import io.deepmedia.effects.creator.read
suspend fun addHat() {
val effect = read("assets/effects/glasses.dme")
val newEffect = effect.edit {
model(name = "hat", path = "assets/models/hat") {
anchor(Face[0].FOREHEAD)
rotate(
x = Face[0].PITCH,
y = Face[0].YAW,
z = Face[0].ROLL
)
}
}
newEffect.write("assets/effects/glasses_and_hat.dme")
}
Unleash creativity
Design innovative UI/UX controls to let anyone in your userbase create their own effects, by using the same engine that powers the Studio app.
Boost engagement
Boost the user engagement by letting users not only consume effects, but also produce them with high-quality results.
Effects as content
AR effects are bundled in a standalone file which can be easily served by your backend, but also shared between designers in your company for iterating.
Expressive APIs
Use our APIs to control the effect development lifecycle, including decompiling and compiling effect files, optimizing 2D textures and 3D models.
DeepCamera SDK
AI-powered lenses.
The DeepCamera SDK gives you complete control over the device camera sensors, so that you don't have to worry about hardware differences and sensor-specific issues. It is integrated with the DeepEffects SDK to show AR effects both in the camera preview and in the media output.
Android
iOS
Built-in effects
Apply AR effects in an integrated environment, without worrying about passing graphical and audio buffers between components.
Easy controls
Control all the sensor capabilities with a single API call, be it flash, focus, exposure, white balance, sizing and much more.
Watermarks
Apply watermarks to the camera picture and video outputs, so that the recorded content is permanently linked to your brand after leaving your app.
Extra features
Leverage built-in, high-level features like bokeh effect to make beautiful portraits, or using the display as a flash for front camera pictures.
DeepEditing SDK
Professional media editing.
The DeepEditing SDK provides a professional media processing solution, including an image / video processor and a set of useful UI components to preview the content being edited and control the editing settings. It is integrated with the DeepEffects SDK to show AR effects both in the live preview and in the processed output.
Android
iOS
Audio Track #1
Audio Track #2
Audio Track #3
Built-in effects
Apply AR effects in an integrated environment, without worrying about passing graphical and audio buffers between components.
Video Transcoding
Transcode your videos to different formats and media options, for example to reduce resolution and bitrate before uploading them to your server.
Segments Editing
Trim video segments, stitch multiple videos together, control the playback speed and apply video and audio overlays.
Image Processing
Create a full-fledged image editor by leveraging our tools for cropping, contrast, saturation, hue, exposure, bokeh effect for portraits and much more.