EXACTLY!!!
Take for instance Fight Club. When Fight Club first came out I went to see it with my Dad. 45 minutes into the movie he leans over and says "I figured out what's going on" and then proceeded to not enjoy the rest of the movie. Afterwards while discussing the movie I said to him "Dad, even though you figured out the twist early on couldn't you recognize the brilliance of the storytelling for the rest of the movie? It was clearly well-done and well thought out." He just shrugged and said "Once I figured it out it just wasn't as enjoyable".
I guess that's the difference between the two groups of movie goers. Imagine our conversations after we both saw Magnolia LOL