Under content, click on "Manage" to add videos to that channel.
 
On the following page you will see a list of all your videos, those with a + can be brought into the channel where you did this.
 
If a video has a checkmark, it means it's already in the channel. Deselecting the video will remove it from the channel.