Synthesizer

Service for adaptive synthesis from template with variable parts

Call	Description
UtteranceSynthesis	tts here will change, just for MVP

Calls Synthesizer

UtteranceSynthesis

tts here will change, just for MVP

rpc UtteranceSynthesis (UtteranceSynthesisRequest) returns (stream UtteranceSynthesisResponse)

UtteranceSynthesisRequest

Field	Description
model	string
Utterance	oneof: text or text_template Text to synthesis, one of for advanced mark up in future
text	string Text to synthesis, one of for advanced mark up in future
text_template	TextTemplate Text to synthesis, one of for advanced mark up in future
hints[]	Hints Optional hints for synthesis.
output_audio_spec	AudioFormatOptions Optional. Default: 22050 Hz, linear 16-bit signed little-endian pcm

TextTemplate

Field	Description
text_template	string hello,
variables[]	TextVariable

TextVariable

Field	Description
variable_name	string
variable_value	string The text of the variable to be synthesized instead of the template.

Hints

Field	Description
Hint	oneof: voice or audio_template The hint for specifying the voice that need to synthesize in the audio.
voice	string The hint for specifying the voice that need to synthesize in the audio.
audio_template	AudioTemplate The hint for specifying the voice that need to synthesize in the audio.

AudioTemplate

Field	Description
audio	AudioContent
text_template	TextTemplate
variables[]	AudioVariable

AudioContent

Field	Description
AudioSource	oneof: content The audio source to read the data from.
content	bytes The audio source to read the data from.
audio_spec	AudioFormatOptions Description of the audio format.

AudioFormatOptions

Field	Description
AudioFormat	oneof: raw_audio or container_audio
raw_audio	RawAudio The audio format specified in request parameters.
container_audio	ContainerAudio The audio format specified inside the file header.

RawAudio

Field	Description
audio_encoding	enum AudioEncoding Encoding type. LINEAR16_PCM: 16-bit signed little-endian (Linear PCM)
sample_rate_hertz	int64 Sampling frequency of the signal.

ContainerAudio

Field	Description
container_audio_type	enum ContainerAudioType WAV: RIFF linear pcm with header audio file format.

TextTemplate

Field	Description
text_template	string hello,
variables[]	TextVariable

TextVariable

Field	Description
variable_name	string
variable_value	string The text of the variable to be synthesized instead of the template.

AudioVariable

Field	Description
variable_name	string
variable_start_ms	int64
variable_length_ms	int64

AudioFormatOptions

Field	Description
AudioFormat	oneof: raw_audio or container_audio
raw_audio	RawAudio The audio format specified in request parameters.
container_audio	ContainerAudio The audio format specified inside the file header.

RawAudio

Field	Description
audio_encoding	enum AudioEncoding Encoding type. LINEAR16_PCM: 16-bit signed little-endian (Linear PCM)
sample_rate_hertz	int64 Sampling frequency of the signal.

ContainerAudio

Field	Description
container_audio_type	enum ContainerAudioType WAV: RIFF linear pcm with header audio file format.

UtteranceSynthesisResponse

Field	Description
audio_chunk	AudioChunk Part of synthesized audio.

AudioChunk

Field	Description
data	bytes Sequence of bytes of the synthesized audio in format specified in output_audio_spec