-
Notifications
You must be signed in to change notification settings - Fork 38
feat: moonshine and whisper streaming #110
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 9 commits
Commits
Show all changes
34 commits
Select commit
Hold shift + click to select a range
b216529
moonshine impl
d9b7712
implemented moonshine on native side, refactored whisper
e3e73fb
Added Moonshine with KV-cache
3e7a639
moved resources to ai.swmansion, draft of hook
d87e132
rebased with fixes, added download progress to s2t controller
b844873
review changes
bf60daf
moonshine finished
f0b374a
changed whisper to 2 modules, implemented useS2T hook, implemented ho…
b36306c
updated modelUrls.ts
97feca1
android s2t wip
382af9a
fixed android side
19e6426
removed tokenzier files
075799c
review changes
d950ad3
yarn.lock
63502dc
fix to android, s2tcontroller small changes
f24f00e
fixed android
a257278
speech-to-text app wip
8e0ccf7
some more s2t changes
5ef98e1
remove s2t app
ea0bc4b
added S2T example app
ec66581
final cleanup
0ee1490
cleaned up package.json
0801c82
hopefully final changes
b12a0f2
maybe now is final
893505f
Merge branch 'main' into @mkopcins/moonshine
c32c589
Podfile.lock
d9b5893
fixed text display in example app
ad25811
fixed some more styling on example app
e395d3a
smallest change of all
84eab7f
Rename bundle identifiers
chmjkb 949359f
Rename bundle identifiers - v2
chmjkb e25f498
Update yarn.lock
chmjkb 808562f
Rebuild android dir in demo app
chmjkb f8db120
checked out computer vision app to main
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -9,8 +9,10 @@ import { View, StyleSheet } from 'react-native'; | |
import { ClassificationScreen } from './screens/ClassificationScreen'; | ||
import { ObjectDetectionScreen } from './screens/ObjectDetectionScreen'; | ||
import { OCRScreen } from './screens/OCRScreen'; | ||
import { SpeechToTextScreen } from './screens/SpeechToTextScreen'; | ||
|
||
enum ModelType { | ||
SPEECH_TO_TEXT, | ||
STYLE_TRANSFER, | ||
OBJECT_DETECTION, | ||
CLASSIFICATION, | ||
|
@@ -23,7 +25,8 @@ export default function App() { | |
regular: require('./assets/fonts/Aeonik-Regular.otf'), | ||
}); | ||
const [selectedMode, setSelectedMode] = useState<ModelType>( | ||
ModelType.STYLE_TRANSFER | ||
ModelType.SPEECH_TO_TEXT | ||
// ModelType.STYLE_TRANSFER | ||
); | ||
const [imageUri, setImageUri] = useState(''); | ||
|
||
|
@@ -33,6 +36,8 @@ export default function App() { | |
|
||
const renderScreen = () => { | ||
switch (selectedMode) { | ||
case ModelType.SPEECH_TO_TEXT: | ||
return <SpeechToTextScreen />; | ||
case ModelType.STYLE_TRANSFER: | ||
return ( | ||
<StyleTransferScreen imageUri={imageUri} setImageUri={setImageUri} /> | ||
|
@@ -51,9 +56,7 @@ export default function App() { | |
case ModelType.OCR: | ||
return <OCRScreen imageUri={imageUri} setImageUri={setImageUri} />; | ||
default: | ||
return ( | ||
<StyleTransferScreen imageUri={imageUri} setImageUri={setImageUri} /> | ||
); | ||
return <SpeechToTextScreen />; | ||
} | ||
}; | ||
|
||
|
@@ -65,6 +68,7 @@ export default function App() { | |
<View style={styles.wheelPickerContainer}> | ||
<ScrollPicker | ||
dataSource={[ | ||
'Speech To Text', | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Delete this |
||
'Style Transfer', | ||
'Object Detection', | ||
'Classification', | ||
|
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.