Tweet Generator - Text Generator API

Text Generator > Use Cases >Tweet Generator - Text Generator API

Tweets Text Generator API - programming tweets example

My favorite programming tweets: ------- I asked @ilyasut how to set neural network init. He accidentally replied with a poem: You want to be on the edge of chaos Too small, and the init will be too stable, with vanishing gradients Too large, and you'll be unstable, due to exploding gradients You want to be on the edge ------- I've been programming for 10 years now. Still feels like magic out of a fantasy: say the words exactly right, and watch your intent get carried out; say the words slightly wrong, and things go haywire. Feeling of wonder and joy hasn't faded one bit. ------- Web programming is the science of coming up with increasingly complicated ways of concatenating strings. ------- If you ever feel alone in this world, read your firewall logs. Problem solved :) ------- Always wanted to travel back in time to try fighting a younger version of yourself? Software development is the career for you! ------- After 17 years as a professional developer, it seems that the answer to every programming question is "it depends" -------

I have no idea what I'm doing I think it's great! - Google's Jeff Dean It depends. But that's my opinion. ;) - Jeff Dean (Google) You want to be on the edge of chaos Too small, and the init will be too stable, with vanishing gradients Too large, and you'll be unstable, due to exploding gradients You want to be on the edge...
I think he might have meant Too small, and the init will be too stable, with vanishing gradients Too large, and you'll be unstable, due to exploding gradients You want to be on the edge Of chaos; I don't know why but that's what comes to my mind... no comment! No comment! I agree! ;) Yes, it's correct.
I'm still learning... The author was not able to find an appropriate image to accompany his answer, so he just added a picture from Google Images. It shows the text "You want to be on the edge of chaos" surrounded by swirls. The original tweet also included other random lines about software development, including "Its no secret that software development is often difficult and stressful work."
I still find my own code unreadable, so I guess I'm not ready yet It should be noted that I didn't use any explicit learning rate schedule or momentum term at all. And that's where the difference lies - no parameters were tuned during training! This is just what we did using our intuition (and some trial-and-error) when setting initial weights. The results speak for themselves: This example shows why gradient descent can easily fall into local minima.