Saturday, September 17, 2016

DEMO / Realtime Blender Facial Animation Vincent Rig





FaceOSC into Blender, realtime facial animation tracking experimental.

Friday, September 16, 2016

IPHONE 7 / First Impression

I am lucky enough to get the iPhone 7 Plus on the first day. I ordered it 5 minutes when it started selling online, and just in time.

I guess queue-ing at Apple Store is no longer prioritized, online reservation is the way to go. Pity because queue-ing is such an experience. However, you will still queue for a bit when you visit the store with reservation details :)

And so decided to make "first impression article". I am actually most interested with the iPhone Dual Camera upgrade and the overall new lens improvement.

Don't care too much about the color or the design similarity with iPhone 6. Haven't really thought too much about the missing jack and the dual speaker. It's certainly a lot louder, almost like the iPad Pro. It is also water resistant up to 1 meter, for 30 minutes. Battery and speed? Also improved! Eventhough I don't use Internet much today, but I took over 1000 photos and videos, and still have 20-30 percents left. Pretty sweet improvement overall. This is probably the most balanced iPhone and very mature in hardware and software.

WAS FASTER, EVEN FASTER!

Both my parents are using the iPhone 6S and my impression from using their camera sometimes is that the camera for 6S was better and sharper, great for 4K video as well. Although to be really honest, from 6 to 6S to 7, I just wish 6 camera was much better like 7 today. Especially aperture wise.

I understand the stabilizer and video is the big push for iPhone 6, although they market it to have a better camera, I think the 6's camera was okay overall. I remember taking 4K video of floating bees, it was gorgeous. Oh, not forgetting the LIVE PHOTOS in 6S. It is still in iPhone 7 and much faster.

iPhone 5 to 6 is always great for fast shooting, and I love the burst mode. Love the slomo.

THE IPHONE 7

Ok, now, switching to iPhone 7, I actually walk 6-7 hours today around Sydney with the iPhone 7 and sometimes taking photos using iPhone 6 and Fuji X100 for comparison.

The improvements from previous model is obvious:
- Daylight shooting is amazingly sharp, almost always looking perfect for scenery. High score for daylight and the color looks ultra natural. Best enjoyed using retina display with high gamut.


- HDR is almost always good looking and no more ghosting. The HDR feels natural color-wise.




- LIVE PHOTOS become really fast and no hickups during day shooting. Google Motion Stills app loves LIVE PHOTOS and I think it is worth taking photos with LIVE PHOTOS at all time!


You can check my Instagram @enzyme69 to see some of the Live Photos x Motion Stills Remix.

- It is still 12 MP only like iPhone 6S, but feels a lot sharper overall.


- Panorama swipe, even higher in resolution and a lot more stable. Faster in low light too.

Not original Panorama. Too big :D




What's NEW with iPhone 7 then?
- Night time shooting is a lot brighter, a lot less noisy. Obviously thanks to the bigger lens aperture. The noise occasionally visible, but I don't know sometimes it seems to try to switch to different lens and suddenly it looks good.

Darker better.




- We got a legit RAW photo saving ability in iPhone 7. I think currently it needs Apps in order to actually save in RAW, which is a pity. Maybe when they update the iOS 10, they will add RAW built in from stock Camera app. RAW is big and extra work though. Always keeps that in mind. I have not really explored much of the RAW, just because it is too dependent on apps (I use Manual, ProCam, haven't tested Lightroom Camera). Manual controls is fiddly sometimes with apps. It takes time to learn one app behaviour. I favor Camera+ from tap tap tap but it does not have RAW support yet.


- Of course not forgetting the DUAL CAMERA system. The optical zoom 1-2x from wide to telephoto is seamless. I don't know exactly how the system works, but they both works together and switching lens is not detectable. It smoothly zoom in and out. We can push to 10x digital zoom, and sometimes it looks perfectly fine for day time shooting. Just imagine "original iPhone" quality when the image is zoomed in (kind of low resolution looking), but still better. Actually when shooting video, resolution of zooming is higher. I mean, you can digital zoom and it still looks great.

Camera Zoom 1x (optical zoom)
Camera Zoom 2x (optical zoom)

Camera Zoom 10x (digital zoom) --- still looking great actually!
- The overall texture and color is brilliant. Maybe there is more to the 12 MP? I remember back then my old compact cameras did not even reach this level of crispiness.

iPhone 7 texture details is great.

FUJIX100 Snippet. Same shot as above.



- Portrait mode and bokeh algorithm --- are not available yet (!)  need to wait for iOS 10 update in few months time. They are still working on it. I have a feeling this iPhone 7 has some hidden tricks. So, I cannot comment or say much about this "bokeh" thing for portrait. I have not got models yet.

A bit of bokeh, but maybe the lighting condition etc and distance matters. I want more BOKEH! More intensity BOKEH!

Few more comparison iPhone 7 plus vs FujiX100 vs iPhone 6 plus

All taken using the default automatic, although I think each device can take a better shot via proper settings or apps (longer shutter, etc). Lens and sensor are also different slightly.

iPhone 7 zoom x1

iPhone 7 zoom x2
Fuji X100
For daytime shooting, iPhone 7 and Fuji X100 are actually a match, or iPhone 7 better? Fuji X100 is a lot older though. For night time however, Fuji can take nice shot, but iPhone stock Camera app cannot. HOWEVER, with apps (slow shutter control) and proper RAW editing, iPhone 7 actually can.
This is iPhone 7 I probably took a bad shot. Could be better, but this is just point and shot.
iPhone 6 Plus.
When comparing iPhone 6 and 7 Plus, night time shot results are different enough, although sometimes iPhone 7 can still take bad photos :) Hard to explain. Maybe the exposure or the noise reduction is badly reducing the quality. Or the auto ISO? Maybe I will have to test some apps and iPhone 7? 

HOW IPHONE 7 COULD BE BETTER?

- The sensor could still improve until it matches camera like FujiX100 (maybe closer each iteration of iPhone). Yes I really wish that one day iPhone camera sensor reaches this level. It will be in few years. However, on the other hand, there are many features via Apps that make the iPhone overall "photography" multiplied in term of capability.



- The control of ISO, aperture, etc. is still not in the stock Camera. It needs a simple control that works. Maybe iPhone needs simpler method to adjust those triangle of exposure. To be honest, with iPhone, unless it can do a realtime result preview like Lightspeed app or Camera+ super ultra low ISO mode, then we don't really have time to manually control those stuffs. No. Personally I think smartphone camera is the best modern street camera for many reasons. Well, not comparing with Leica or Fuji camera, but the iPhone stands on its own. It's different. iPhone is instant with a lot more.
Shooting up sometimes awkward. Noise is pretty bard here, because ISO.

- The ergonomic of iPhone. Now this is a tricky one. The design of iPhone is super simple, almost no way to hold it properly, slippery even, but of course we can eventually find a proper way to hold it, but still fragile. Actually a heavier case with handle can help, but that's an additional thing. I am using the expensive Apple "leather" case, a bit slippery still. Anyhow, with iPhone, if you use it as photography camera for a while, you should know that the shutter sometimes is best triggered from the volume rocker (not the screen), and that's at the left hand thumb. Sometimes you want to do that. Another way is to use Peek and Shoot single-handedly.



- There is this weird thing with iPhone 7. The screen is too fast, too responsive, and thus easy to take accidental photos. You will understand what I mean if you try the iPhone 7 yourself. Those extra blurry shots after taking photos. 1% of the time.


IPHONE 7 AND BEYOND

There you go, my first overall impression of iPhone 7. So far so good, the iPhone I always wanted. From 4 - 5 - 5S (great) - 6 Plus and now 7 plus, it's a great evolution unlike others. Every iteration and cycle is an improvements. Wonder how the next iPhone is going to be? Maybe they will focus more on the "deep learning" and "deep 3D" for augmented reality? But what's "photography" on iPhone is going to be? Lytro like? We will see!

Monday, July 18, 2016

Exploring Deep Neural Style with Pikazo app

Every now and then, there is an iOS APP that seems to be really unique and way ahead of its time. I wanted to deeply talk and write about PIKAZO app by Pikazo Inc.

Pikazo 2 Logo

This app allows users to mix and remix ART STYLE and SUBJECT of their own (photographs, sketches, etc) and generate image graphic output that is worth further studying or perhaps as a new original Art pieces especially when printed out into canvas or other products.

The resulting image will be as if the original Artist is painting and recreating for your photo.

You might have heard of recent popular app like Prisma that supposedly can turn photos into stylized graphics? Now, this PIKAZO app does a LOT more and more true to the nature of style transfer.

Keep in mind that this is not the usual sketch filters that we already have for years via Photoshop. With Neural Style Transfer, the machine actually does quite a hard job in separating elements and then re-assemble back into the original photo. At least that how I think of this process.
 
Below is just a quick examples of my creation using the Pikazo app:

iPhone Selfie (2016)

My Wife (2016)

Pretty impressive right? I think so! Let's see some more, but beforehand, I want to give a bit of background story on "neural art transfer" from "deep dream".

STORY OF DEEP STYLE TRANSFER BEFORE PIKAZO APP

My interest in this "Art Style Transfer" actually started a few months ago when I got to an interesting exploration area called machine learning and neural network and deep dream (that I stumbled by accident while I was studying and researching about Python and Jupyter iPython Notebook):  

GOOGLE DEEP DREAM DEMO
https://github.com/google/deepdream

Machine learning is a branch of computer science that try to take data, analyze data and find patterns do this automatically. Potential is huge, including voice recognition, image recognition, etc.

Like most curious geeks, I actually tried to setup my own "Deep Dream" using my own home computer. And I did it, with lots of hassles. Took me hours and eventually days of researching and trying to install all sort of Python repositories and it eventually works.

The setup is long and to get result is also takes a while.

Deep dream algorithm itself is a nice graphics demo displaying computer machine ability to draw photos using collection of photos.

Candi Borobudur by Philip Lesmana photo, redrawn using Temples

Cat on Pot (1998) photo, redrawn using Dog Photos
Google Deep Dream demo is fascinating in itself. This was show around about a year ago in 2015.

Now... from deep dream to "neural style transfer".

The next step in deep dream is neural style transfer, that is less bizarre, but more aesthetically beautiful.

Parisian Ballerina, photo by Jimmy Gunawan. Made in Pikazo.


The process of making "art style transfer" is actually slow and painful. Especially if the machine is using CPU only. Maybe 512 pixel max dimension will take around 30+ hours. Yes, really that slow and painful. Pikazo app does it in under 5 minutes only!

- Deep Dream GPU, can be fast depends on your machine
- Neural Style CPU slow, GPU is really hard to setup
- Neural Style using Pikazo app and Pikazo cloud computing => 5 minutes for 500 x 500 pixel.

I actually found one of Neural Style Transfer repository from GitHub that allows me to create something like below:

Photo is from Emrata / Emily Ratajkowski Instagram photo, and I use anime style graphic to transfer into.

I found that the neural style to be totally amazing research and unusual. In a way, this is a very quick way to see "what result we get when we transfer art style with a photo".

Maybe this can be an ART IN PROGRESS thing? Not a final result? Perhaps it can help people to study art style? And can be more appreciative of the art, when applied to own SUBJECT / CONTENT? This is what I continue to test using the Pikazo app.

A photo posted by Jimmy Gunawan (@enzyme69) on

WARNING: ART REMIX AND COPYRIGHT ISSUE (!)

Since I started this "neural style transfer" exploration, I am completely aware and be really careful with copyright issue. Especially when remixing CONTENT and ART STYLE.


Made in Pikazo.

One cannot just mix a photo taken by others and Art Style painted by artists and mix the two and make his/her own.

So, I tried as much to use my own CONTENT / SUBJECT creation, and remixing it with FOUND ART STYLE that I can give credit and attribution.


Photography by Willy Gunawan, my brother. Style: Unknown. Made in Pikazo.

There are limitless ART STYLE to explore out there from Kandinsky until recent modern artists. I definitely appreciate ART STYLE nowadays after Pikazo.

For my own art daily project, I am using old and new photos of mine, recycling years of photos I collected in Flickr and now I use Pikazo to bring it back to life.

If you are feeling adventurous, you are not necessarily need to mix Photo with Style of Art, you could easily mix your own Painting Styles, or Handrawing or perhaps Textures into calculation. You will get some interesting result!

Japanese Girl 05, Made in Pikazo.

Japanese Girl 14, Made in Pikazo.


DISCOVERING PIKAZO and PIKAZO 2 




Pikazo app was originally created by Karl Stiefvater, just a few months ago. I found Pikazo probably by lucky accident. It is a simple app that can transfer STYLE into CONTENT, mix the two and the result is a 500 x 500 pixel dimensions of art. It actually does EVERYTHING that I have tried to do when exploring all kinds of method to do Neural Style transfer using my own computer, and a lot simpler too, thanks to smartphone capability to do it on the fly (I use iPhone).

There is of course a sense of satisfaction having able to make the Neural Style setup using own machine. Before later on finding out some smarter people out there are doing the same and create the tool that does more and I really appraise Pikazo Inc. for this!

So, this is the next step my exploration in Neural Art Style Transfer and I tried using an old photo of mine of this black dog at Crown Street.

I actually test it on hundred of styles using Pikazo app. It gives me 500 x 500 pixel output.

"Black Dog" (2016) Made in Pikazo.
Before long, Pikazo 2 app actually came to surface. Pikazo 2 is a more refined version of the app, allowing users to do more like reading MUSE area for article and inspiration of style. And also users can join the PIKAZO SALON Facebook Group, where other Pikazo artists shares their artworks and talks and comments.

Pikazo 2 by default allows you to draft and create 800 x 800 pixel art works. Don't let the dimension trick you, 800 pixel is actually quite high resolution for sharing.

Portrait Photo and Model: Ricky Adrian / Kie Photography. Made in Pikazo..

If you like to go further on your own artworks, you can apparently buy Jetons and output up to 3200 x 3200 pixels dimension. Large enough to output and print into Canvas or others like T-Shirt or Mugs or whatever design items. Maybe even iPhone case? Yes, why not :)

PIKAZO TIPS



For beginner Pikazo users, I can give you some tips:
  • Collect all kind style and photos and be experimental
  • Try using close up PORTRAIT or perhaps SELFIE, often time it gives you nice result. As silly as selfie may seem, actually with Pikazo, even the silliest face looks awesome.
  • Pikazo Style works best for the most ABSTRACT STYLE, but try all kind of ART STYLE with interesting paint stroke details, and be surprised!
  • Explore all kind of Art Style
  • Use high resolution photo and art if you can
  • Find more inspirations at Pikazo Salon


Black Dog XIV. Made in Pikazo.

OTHER STYLE TRANSFER APP AND PLUGIN

Below is a Deep Style Transfer result using Dwango Python Chainer Plugin for OpenToonz. I tested this using my own machine at home, and took me a few hours to develop and get result. It is very slow on CPU, perhaps faster using GPU, but not easy to setup.

The Prisma app actually does this kind of style very similarly. So I guess it is probably using the same quick and shortcut technique implemented.



Overall, the neural style result you like is back to own personal taste. Prisma app is interesting and fast, it gives effect that is more like a Photoshop filter.

I think I much prefer to use Pikazo for more REAL and sophisticated result. Art form should continue to evolve, analog or digital, or anything. Re-discover old and new styles. Remix it. Appreciate it.

ONE MORE THING...

 I remixed 400 results of "black dog" that I have collected on the same subject, below is "The Black Dog" superimposed over one another. It becomes almost like a real painting:

Result of mixing 400 styles. Almost like original photo, but it feels like real art.

What is next? Probably Neural Art Style applied into movie or animation? We shall see!

"The Gap" (2016), Sydney, Made in Pikazo.


SEE ALSO:
"Loving Vincent" (2016) Trailer


Thanks to Pikazo app this "neural style transfer" becoming an accessible area is for everyone to explore! Using just own smartphone and some bits of creativity, we can create a "NEW" and interesting art result. Have fun and enjoy!

A photo posted by Jimmy Gunawan (@enzyme69) on


Famous photo of Dalai Lama, using my own Instant Noodles as style.

Thursday, June 9, 2016

Top 5 Most Favourite iOS Apps

Over the years, I am keeping a keen eyes over new apps, their development and updates, especially for iOS, iPhone and iPad.

iPhone is now around 9 years and iPad is about 6 years old in 2016. Over this period, we have seen the iOS got updated few times. Especially a total big change for iOS 7. That time, many apps are needing to get updates. Some developers actually gave up or disappear, but some apps continue to shine and get the updates deserved.

There are some apps that deserve recognition as the Developer continued to add features and kaizen-ly make the app faster and better. Here are the top 5 most favourite apps that continue to get updates and surprisingly good since the original iPad:

1. Paper Fifty Three 53 

Paper 53 is a beautiful drawing and painting app to quickly notes idea in the most elegant way. This app was originally made for iPad only, but now it is also an iPhone app. It was a big thing when iPhone version was released. The tools and the design were re-arranged and made to work just as good on iPhone, like it has been on iPad.

Paper 53 never lag when drawing, this is one of the big reason why I like this app. I use to work with just finger touch, and these days, I can also use the app with Pencil and iPad Pro.

I also remember when they released their Pencil 53 device that works together with Paper 53 app in such a way that is truly groundbreaking. 

In latest version update, they made the app works even better with Apple Pencil and iPad Pro. This app is definitely my top favourite to jot my thoughts and ideas in drawings and skethches.

2. Photosync

This app was made long before Air Drop was introduced in iOS. It allows any iOS device to share Photos and Videos via Wifi network. All it needs is to hook into the same Wifi and we can easily transfer photos. This also works with OS X. 

If I am not wrong, Photosync actually works with iBeacon, can trigger sync with a compatible device when you are nearby.

Sometimes when Air Drop failed, Photosync is the best alternative!

3. Camera+ by Tap Tap Tap

This is one company that pushes iPhone volume to functino as Shutter. It was banned originally by Apple, but all change when Apple actually allows shutter function to be triggered by volume.

Camera+ just recently got updated to include beautiful low light mode and long shutter. This is also unlike any other camera app out there.

Camera+ features advanced control over Camera, this is usually my choice of camera app if the default Camera for iOS is not capable.

4. GoodReader

Apple iOS is actually needing a better iCloud Drive File Manager. GoodReader has been there for quite a while and it has gone through 2 incarnations. GoodReader is one of the best file manager that I know of, it features cool stuff such as:
- Touch ID pass code
- Locking of folders
- Sync to other service (DropBox, Google Drive, etc)
- Easy sharing via Wifi
- Ability to deal with Text (speech, dictation)
- Best to store all kind of files (MP3, PDF, etc)

5. iCabMobile browser

This is one ultimate browser that gives a lot (like A LOT) of features on top of what Safari might already provide. Safari is probably super basic.

iCabMobile on the other hand, has gone through many updates over the years. The developer keeps adding useful features, such as:
- Split View built in the app
- All kind of plugins you expcect from browser, and more.

I always recommend or mention these 5 apps everytime my friend got their new iPhone/iPad, and very likely they will need it.

There are few other apps out there, if I make a Top 10 List, I will also include:

Air Video HD

This app has been there for a while for iPad, and when retina iPad arrived, it become HD. It still works today with 4K streaming for iPad Pro. It streams from computer to iPad or iPhone, to multiple iOS devices.

RManager

This app is little bit similar to GoodReader, however this app actually can read your computer within same network and goes inside and stream video and manage files (deleting, copying, etc).

But RManager is a great videoplayer also, it has a built in video player that works with gesture.


Closing Notes...
Those above are some apps I truly think brilliant, they show functions that are beyond a simple function of consuming medias.

iPhone and iPad will continue to grow via the apps. There are actually hundreds of iOS capabilites that are unlocked. Sometimes only possible via Jailbreak.


Monday, April 25, 2016

The Path to iOS Enlightenment

You can ask people around me, sometimes I do treat technology and software like a RELIGION, especially with technologies that are dear to me:

  • My smartphone (iPhone)
  • My tablet (iPad, there is no other tablets!)
  • My computer (MacBookPro)

Why would I do that? My own personal reason is because if one does not believe in any "thing", there is not going much excitements or fun in it.

I believe in Apple since 2010.

LIKE A LEICA LOVE

My younger brother Will for example, has his fascination and believe in camera like Leica and film photography. A bit of ideal romantic for a photographer. For him, beautiful film and print will be the last ultimate result. On that topic, I am a total opposite. Although I have my fascination with film, but my heart is set on Digital, not so much on Analog.

For now, my camera of choice is the iPhone, besides FujiX100 and Olympus PEN. I also have my dusty D700 from my dad. A very good camera, but too bulky and impractical for me. Well, I still use it time to time, but these days, iPhone is always besides my pocket.

I definitely will talk about iPhone-o-graphy more in future articles. Including some photography apps.

Some people treat technology with little or not much respect, changing from one tech to the next tech device, little concern of brand and models following trends and specs numbers, which is a total disgrace in my opinion.

I rather give more respects to people that stick with one brand, providing he/she is not being an ass about it. For all right reasons, you choose your personal "belief".

In the end, the tools that gives you a lot more than just functionality, is something you have to hold into. Not so much of brands. But the people who embrace the tech.

It is not unlike I am following the path of Guy Kawasaki (one of famous Apple Evangelist). I do have big respects in people that gives technology an equal respect. Other person I recall and respect will be the educator John Maeda. He also has his thing on Apple years back.

THE 1st IPAD CHANGES EVERYTHING

It has been a few years since I bought my first iPad and iPhone.

My 1st iPad in 2010 was indeed the most memorable. It does not have cameras, it was a bit heavy, it was a bit slow too and so many past things iPad that way behind compared to current iPad Pro with Pencil! I remember holding the iPad with Grabbit cover that allows my iPad to stay on the palm of my hand. It is just brilliant.

I love my iPad more before I fall in love with the iPhone. That is always the important note.

Here is the whole truth about my change of "religion" into Apple:
I used to just use PC Windows and I rely on Google and put a big trust on those brand and services. I used to avoid anything Apple related. I had my bad experience using Apple back in the college time, because the Macs were a bit old.

I was waiting for "the tablet" from Microsoft or Google... it never come to surface. Till suddenly, the iPad was announced by Steve Jobs. I was like... "I MUST HAVE THAT THING!".

So I bought the iPad and love it since the first day. The iPad is the key into Apple.

It follows with owning the iPhone 4S, which is my first iPhone. And then iPad 2. Which I accidentally drown because of bottle water inside my bag (never ever put bottle water and iPad inside same bag). But then Apple Genius man called Adam replaced my iPad 2 with brand new refurbished iPad. And I was total live changing experience for me.

And a bit later, I queued for iPhone 5S and iPad Air. It was quite an experience.

When you choose Apple as your device and embrace it, you should be "the crazy one".

SIMPLICITY OF SOFTWARE & HARDWARE

I also owned the MacBookPro, just a basic one. Mid 2010 model. The one I am currenly using to type this blog article. It's old and a bit slow now with El Capitano. I might need to retire this soon, thinking to buy new MacBookPro 2016.

I have been adapting to OS X and iOS ever since I own the iPad, iPhone and MacBookPro. All three different devices but all with an elegant UI experience and built in apps.

Apple built in apps featured in both OS (iOS and OS X), although can be easily overlooked by users, are simply brilliant and not something to take granted for:
- Notes
- Photos (covers webcam feature, front camera, back camera)
- Maps
- Calendar
- iTunes (the love hate relationship app)
- Safari (web browser)
- Musics
- Reminder
- Siri (includes Voice Over, Dictation, Dictionary, and Speech)
- and many more

There have been some evolutions going on with OS X and iOS since that time Steve Jobs passed away and being replaced by Tim Cook. I think Apple is aligning itself and a lot simpler and actually bettter vision.

On top of the software, Apple also does its own hardware, which works efficiently with the software. This is always a very important point when owning Apple devices.

When Apple announced Pencil and drawing capability, it is something that eventually be supported all across.

Now, it will not be long until Apple announce the iOS 10 and I think it is a good time to start a blog like this, to talk about Apps, about the iOS, and everything in between.

NOT PRO/EXPERT, BUT ALL ABOUT CONTINUES EXPERIENCE

Price tag is something one needs to be aware of when choosing their "Joy" machine of choice. Apple products, obviously is not cheap. At a glance you may be shocked.

The right way to buy Apple products is to buy the MEDIUM PRICE option. Not the most expensive one, unless you have that extra cash.

After all, you will find out that you can buy MANY other devices but disappointed with its quality. But be happy with ONE a really good device, in this case thing like Apple's iPhone, iPad, and MacBookPro.

Of course, there are the ups and downs in my passion for Apple. Sometimes there is a really good apps that are suddenly discontinued by the developers. It is totally unavoided.

Anyhow, let see how this blog would develop from today.