While many people try to treat it like the Jewish answer to Christmas, Hanukkah is not actually a major holiday in the Jewish calendar. Yes, it's in December, makes use of candles, and involves giving of gifts, but instead of being vital to the religion as Christmas is, it is a celebration of a miracle. As the story goes, the Maccabean revolt against Syria's Seleucid Empire was able to retake the Second Temple of Jerusalem, but discovered that the oil meant to light the temple fires had been contaminated so that it could no longer be ritually used. The tiny amount of still-pure oil remaining should only have been able to keep one menorah lit for one day, but managed to last the eight it took to press and ready more oil. Thus Hanukkah is an eight-day celebration.
If you look down at the books below, you'll notice that while Hanukkah is the most common spelling, it isn't the only one. This is because the Hebrew language uses a different writing system than English does, including letters that make sounds that our language doesn't have. Moreso, the Hebrew langauge itself has changed over the years, so while the first letter used in Hebrew stayed the same between classical and modern Hebrew, the sound that it made changed. As a result, starting the word with Ch is technically just as accurate as starting it with H - but unless you're good with Hebrew phonetics, use an H-sound when you say it.
Story of Hanukkah by
Beautiful Yetta's Hanukkah Kitten by 
Honeyky Hanukah by 
Simon and the Bear by 
Hanukkah Bear by 
How Do Dinosaurs Say Happy Chanukah? by 
The Hanukkah Hop! by 
A Confused Hanukkah by 
This Is the Dreidel by 
Hershel and the Hanukkah Goblins by 
Dreidels on the Brain by Unlike much of what goes on in December, Kwanzaa is a cultural holiday, not a religious one. Derived from the Swahili word for "First fruits of the harvest" (as Swahili is a commonly shared language in East Africa), it is a celebration of African-American heritage and values that deliberately draws from multiple harvest festival traditions. While it is definitely a gift-giving holiday, Kwanzaa is not mutually exclusive with Christmas; many families celebrate both (Santa's Kwanzaa, in the booklist below, shows just this.) Kwanzaa lasts seven days, with each day focused on celebrating seven principles to live by; these include unity, self-determination, collective responsibility, cooperative economics, purpose, creativity and faith.
(All information from the first book on the list below.)
Li'l Rabbit's Kwanzaa by 
Santa's Kwanzaa by 
My First Kwanzaa by