Subject: General Tech | November 8, 2016 - 08:00 AM | Scott Michaud
Tagged: voco, stylit, premiere pro, clovervr, audition, Adobe
At their annual MAX show, Adobe hosts a keynote called “Sneak Peeks”. Some of theses contain segments that are jaw-dropping. For instance, there was an experimental plug-in at Adobe MAX 2011 that analyzed how a camera moved while its shutter was open, and used that data to intelligently reduce the resulting motion blur from the image. Two years later, the technology eventually made its way into Photoshop. If you're wondering, the shadowy host on the right was Rainn Wilson from the US version of The Office, which should give some context to the humor.
While I couldn't find a stream of this segment as it happened, Adobe published three videos after-the-fact. The keynote was co-hosted by Jordan Peele and, while I couldn't see her listed anywhere, I believe the other co-host is
Elissa Dunn Scott from Adobe. ((Update, November 8th @ 12pm EST: Turns out I was wrong, and it was Kim Chambers from Adobe. Thanks Anonymous commenter!))
The first (and most popular one to be reported on) is VoCo, which is basically an impressive form of text-to-speech. Given an audio waveform of a person talking, you are able to make edits by modifying the transcript. In fact, you are even able to write content that wasn't even in the original recording, and the plug-in will synthesize it based on what it knows of that person's voice. They claim that about 20 minutes of continuous speech is required to train the plug-in, so it's mostly for editing bloopers in audio books and podcasts.
In terms of legal concerns, Adobe is working on watermarking and other technologies to prevent spoofing. Still, it proves that the algorithm is possible (and on today's hardware) so I'm sure that someone else, if they weren't already working on it, might be now, and they might not be implementing the same protections. This is not Adobe's problem, of course. A company can't (and shouldn't be able to) prevent society from inventing something (although I'm sure the MPAA would love that). They can only research it themselves, and be as ethical with it as they can, or sit aside while someone else does it. Also, it's really on society to treat the situations correctly in the first place.
Moving on to the second demo: Stylit. This one is impressive in its own way, although not quite as profound. Basically, using a 2D drawing of a sphere, an artist can generate a material that can be applied to a 3D render. Using whatever they like, from pencil crayons to clay, the image will define the color and pattern of the shading ramp on the sphere, the shadow it casts, the background, and the floor. It's a cute alternating to mathematically-generated cell shading materials, and it even works in animation.
I guess you could call this a... 3D studio to the MAX... ... Mayabe?
The Stylit demo is available for free at their website. It is based on CUDA, and requires a fairly modern card (they call out the GTX 970 specifically) and a decent webcam (C920) or Android smartphone.
Lastly, CloverVR is and Adobe Premiere Pro interface in VR. This will seem familiar if you were following Unreal Engine 4's VR editor development. Rather than placing objects in a 3D scene, though, it helps the editor visualize what's going on in their shot. The on-stage use case is to align views between shots, so someone staring at a specific object will cut to another object without needing to correct with their head and neck, which is unnecessarily jarring.
Annnd that's all they have on their YouTube at the moment.
Subject: General Tech, Graphics Cards, Processors, Shows and Expos | April 8, 2014 - 07:43 PM | Scott Michaud
Tagged: Intel, NAB, NAB 14, iris pro, Adobe, premiere pro, Adobe CC
When Adobe started to GPU-accelerate their applications beyond OpenGL, it started with NVIDIA and its CUDA platform. After some period of time, they started to integrate OpenCL support and bring AMD into the fold. At first, it was limited to a couple of Apple laptops but has since expanded to include several GPUs on both OSX and Windows. Since then, Adobe switched to a subscription-based release system and has published updates on a more rapid schedule. The next update of Adobe Premiere Pro CC will bring OpenCL to Intel Iris Pro iGPUs.
Of course, they specifically mentioned Adobe Premiere Pro CC which suggests that Photoshop CC users might be coming later. The press release does suggest that the update will affect both Mac and Windows versions of Adobe Premiere Pro CC, however, so at least platforms will not be divided. Well, that is, if you find a Windows machine with Iris Pro graphics. They do exist...
A release date has not been announced for this software upgrade.
Subject: General Tech, Graphics Cards | April 5, 2013 - 03:48 PM | Ryan Shrout
Tagged: premiere pro, opencl, firepro, amd, Adobe
As we prepare for the NAB show (National Association of Broadcasters) this week, AMD and Adobe have released a fairly substantial news release concerning the future of Premiere Pro, Adobe's flagship professional video editing suite.
Earlier today Adobe revealed some of its next generation professional video and audio products, including the next version of Adobe® Premiere Pro. Basically Adobe is giving users a sneak peek at the new features coming to the next versions of its software. And we’ve decided to give you a sneak peek too, providing a look at how the next version of Premiere Pro performs when accelerated by AMD FirePro™ 3D workstation graphics and OpenCL™ versus Nvidia Quadro workstation graphics and CUDA.
This will be the first time that OpenCL is used as the primary rendering engine for Premiere and is something that AMD has been hoping to see for many years. Previous versions of the software integrated support for NVIDIA's CUDA GPGPU programming models and the revolution of the Mercury Playback Engine was truly industry changing for video production. However, because it was using CUDA, AMD users were left out of these performance improvements in favor of the proprietary NVIDIA software solution.
Adobe's next version of Premiere Pro (though we aren't told when that will be released) switches from CUDA to OpenCL and the performance of the AMD GCN architecture is being shown off by AMD today.
Using 4K TIFF 24-bit sequence content, Microsoft Windows® 7 64-bit, Intel Xeon E5530 @ 2.40 GHZ and 12GB system memory, AMD compared several FirePro graphics cards (using OpenCL) against NVIDIA Quadro options (using CUDA). Idealy we would like to see some OpenCL NVIDIA benchmarks as well, but I assume we'll have to wait to test that here at PC Perspective.
AMD also claims that by utilizing OpenCL rather than CUDA, the AMD FirePro GPUs are running at a lower utilization, opening up more graphics processing power for other applications and development work.
While this performance testing is conducted on a pre-release version of the next Adobe Premiere Pro, we’re really pleased with the results. As with all of the professional applications we support, we’ll continue to make driver optimizations for Adobe Premiere Pro that can only help to improve the overall user experience and application performance. So if you’re considering a GPU upgrade as part of your transition to the next version of Adobe Premiere Pro, definitely consider taking a look at AMD FirePro™ 3D workstation graphics cards.
You can continue on to read the full press release from AMD and Adobe on the collaboration or check out the complete blog post posted on AMD.com.