The cover of the album (above) was painted by Dylan in "five minutes" and below is an Interview by Rolling Stone from 1984.
"At the time, I was in Woodstock, and I was getting a great degree of notoriety for doing nothing. Then I had that motorcycle accident [in 1966], which put me out of commission. Then, when I woke up and caught my senses, I realized that I was workin' for all these leeches. And I didn't wanna do that. Plus, I had a family, and I just wanted to see my kids.
I'd also seen that I was representing all these things that I didn't know anything about. Like I was supposed to be on acid. It was all storm-the-embassy kind of stuff — Abbie Hoffman in the streets — and they sorta figured me as the kingpin of all that. I said, 'Wait a minute, I'm just a musician. So my songs are about this and that. So what?' But people need a leader. People need a leader more than a leader needs people, really. I mean, anybody can step up and be a leader, if he's got the people there that want one. I didn't want that, though.
But then came the big news about Woodstock, about musicians goin' up there, and it was like a wave of insanity breakin' loose around the house day and night. You'd come in the house and find people there, people comin' through the woods, at all hours of the day and night, knockin' on your door. It was really dark and depressing. And there was no way to respond to all this, you know? It was as if they were suckin' your very blood out. I said, 'Now wait, these people can't be my fans. They just can't be.' And they kept comin'. We had to get out of there.
This was just about the time of that Woodstock festival, which was the sum total of all this bullshit. And it seemed to have something to do with me, this Woodstock Nation, and everything it represented. So we couldn't breathe. I couldn't get any space for myself and my family, and there was no help, nowhere. I got very resentful about the whole thing, and we got outta there.
We moved to New York. Lookin' back, it really was a stupid thing to do. But there was a house available on MacDougal Street, and I always remembered that as a nice place. So I just bought this house, sight unseen. But it wasn't the same when we got back. The Woodstock Nation had overtaken MacDougal Street also. There'd be crowds outside my house. And I said, 'Well, fuck it. I wish these people would just forget about me. I wanna do something they can't possibly like, they can't relate to. They'll see it, and they'll listen, and they'll say, 'Well, let's get on to the next person. He ain't sayin' it no more. He ain't given' us what we want,' you know? They'll go on to somebody else. But the whole idea backfired. Because the album went out there, and the people said, 'This ain't what we want,' and they got more resentful. And then I did this portrait for the cover. I mean, there was no title for that album. I knew somebody who had some paints and a square canvas, and I did the cover up in about five minutes. And I said, 'Well, I'm gonna call this album Self Portrait.' "