Skip to content

AkishinoShiame/AI-Kernel

Repository files navigation

AI Kernel

This project implement a server-client structure application with NLP, emotion recognition and Virtual Agent.

Details

--Respository's name-- --description--
AI-Kernel-Datasets Datasets of the Speech Spectrogram with emotion tag.
AI-Kernel-Server-Structure The server code and main part of structure, using python.
AI-Kernel-Chatbot-App The main part of client structure, using unity to build up for multi-plaftform.
AI-Kernel-Chatbot-IOS-Project-IOS-12 The IOS project (Opened with Xcode) of Virtual Elderly Chatbot App.
Test data was random picked from all Counts data.

Structures

alt text

Client : Unity ==> Xcode Proj ==> IOS app ( if want, can have a try on android.)

Important !!!

Please cites this peper belows if you used this respositories.

Lee, M. C., Yeh, S. C., Chiu, S. Y., & Chang, J. W. (2017, June). A Deep Convolutional Neural Network Based Virtual Elderly Companion Agent.

Ming Che Lee, Sheng Cheng Yeh, Sheng Yu Chiu, Jia Wei Chang.
 "A Deep Convolutional Neural Network Based Virtual Elderly Companion Agent",
 MMSys'17 Proceedings of the 8th ACM on Multimedia Systems Conference,
 Pages 235-238, June 20 - 23, 2017, Taipei, Taiwan. (EI, SIGMM, accept rate: 28%)

Release Note

This project becomes production around 令和1年6月 .

The project is been given a formal name called "AI Kernel".

2017.09.01

First beta release, finished all the function and codes makes both server and client works.

The version of the Server using python 2 on NVidia DIGITS server and python 3 on Chatbot Server.

Client version using Unity 5.6.2f1 version build to iOS 11 (beta) version.

HardWare tested:

Server: i7-4790 (3.6 GHz), 16GB RAM, Nvidia 1050Ti 4G DDR5 GPU.

Client: iPhone SE.

Check for details in Here.

2018.12.24

Rebuild the release and update the codes if needed.

Discuess with new enviorment to build the service.

2019.04.17

Trying rebuild the server part.

HardWare as the link:

Japanese English Chinese

2019.06.17

Update the release documentation of this project.

Read the Document from Here

Found there are some update for the latest verison of NVidia DIGITS (v6.1.1). Fixed the NVidia API part code.

Found error when convert spectrogram to jpg format. Changing codes to use PNG format instead.

May have a update release of the server code in recent future.

2019.07.02

Update the Server code locate in this folder

Set-up a V2.0 release(May be final). Which can found in Here.

May have added update & release for builds on Unity and IOS 12 in recent future.

Update @ 22:49 JPT with IOS 12 release project

Create production Release.

Create and update documentation in "令和Update" release.

Video DEMO

Demoムービ

alt Demoムービー