Can I unpublish or hide skills discovered by WhoKnows?

Of course! You are always in complete control of who can see what. To hide skills, just click the Edit button on the What I Know section of your profile and click the Hide button for any skills that you don't want to appear in your public profile any more.