Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how can you ensure that the output is a smooth sentence? #65

Open
zhsamy opened this issue Nov 7, 2016 · 1 comment
Open

how can you ensure that the output is a smooth sentence? #65

zhsamy opened this issue Nov 7, 2016 · 1 comment

Comments

@zhsamy
Copy link

zhsamy commented Nov 7, 2016

I also refer to the paper Sequence to sequence learning with neural networks by tensorflow, but there are many repeat words in the outputs and the sentence is not smooth like yours. Would you mind telling me some tricks about your code?

@Conchylicultor
Copy link

Conchylicultor commented Dec 20, 2016

Sorry if I'm late.
If the words are repeating, it may be because you don't train it long enough. It's usually the case at the beginning of the training. You can also try to change the learning rate see if it changes anything.

Otherwise, for the training tricks, you may already know them but here are some I discovered while doing a similar project: https://github.com/Conchylicultor/Deep-Learning-Tricks#seq2seq (see section seq2seq)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants