Special offer

Zillow Agent Reviews: A Request for Sanity

By
Managing Real Estate Broker with Howard Hanna Rand Realty License # 49FA1074963

Insert Sally Field snippet hereYou might notice in the Sidebar of my blog that I have some excerpts to client reviews I have received with a link to my Zillow profile and ratings.

When Zillow announced their agent ratings system, I voiced some understandable skepticism. However, Sara Bonert, whom I like and respect, gave me some rather convincing reassurances that safeguards would be taken against system gamers and fraudulent reviews from the unscrupulous. I then published a post, to be fair, that Zillow was going about this ratings system in a responsible way. I wish it ended there. It doesn't. 

I have to tell you that as an owner and operator of a company, this is a seasaw that I wish would stop moving.  A few days ago, I received an email that began with the following:

A review was submitted for your Zillow profile indicating that you did not respond to the Reviewer’s inquiry. Consumers who contact you through Zillow or otherwise have the opportunity to share their experience by submitting such a rating and review.

Since we realize that things outside your direct control could have contributed to this, and because we assume that you have every intention of following-up with leads, we are extending you a “Free Pass” and will not publish this review on your Zillow profile. Please note that this is a one-time courtesy and that you will not receive a “free pass” for similar reviews submitted for you in the future. We kindly ask that you follow-up with any and all leads that come your way, and that you ensure your Zillow profile is kept updated with your most current and reliable contact information.

Let's set aside the reference to inquiries as "leads." So, apparently, not just clients or customers can rate us. Anyone with a keyboard and Internet access can. Some guy somewhere inquired about something on Zillow, presumably to me, didn't hear back and attempted to give me a review saying I ignored them. That would very likely to damage to a 5-star rating that I have earned through hard work and dedication to my clients in the sidebar. This is ridiculous.

Zillow agent ratings system still needs workFirst, anyone that knows me will attest to the fact that I follow up on all consumer inquiries pretty zealously. It is how I built my company and why I sell the volume that I do (an "off year" where I only rank 22nd in transactions out of 6500 in my MLS, putting me in the top 0.3% in ubercompetitive suburban New York). I don't need Zillow's bot wagging it's cyber finger at me to do my job.

Well, I do my job. There are just too many variables at play for a random consumer inquiry to have the same power to review me that a past customer or clients has. As you might expect, many consumer inquires through online portals like Zillow are from people with emails with typos or phone numbers like (000) 111-2233. Not everyone that is asked for their contact information will give it. Moreover, even in the cases of well meaning consumers, responses can be sent to spam folders, overlooked,  or otherwise missed through no fault of mine. And anyone who has spent 30 minutes in the real estate business will attest to the fact that a huge number of answers to consumers go unacknowledged. If I had a dime for every email and voicemail that went to black hole hell I'd retire. It is the business. How am I supposed to know if my response got through? And if you pester people, they get annoyed and time is lost from more fruitful endeavors. 

We can argue all we want whether a brokerage like Redfin, a 3rd party aggregator like Zillow, or anyone for that matter should rightly be a conduit for agent reviews. I for one am fine with it- so long as the execution is done correctly. This is absolutely not done right, and it flies in the face of the assurances I was given. I was given a mulligan this time, but what about next time? Any creep can tank my hard earned ratings? Seriously? 

Zillow needs to do the right thing and give the power to rate agents only to those people who have actually worked with the agent, not to any random guy who sent an email once. There is too much room for the abuse that I was assured would not occur. 

 

Comments(106)

Anna Tolstoy
Coldwell Banker Residential Brokerage - Natick, MA

Phil, I came to your blog through Leslie's. After reading comment #79, I want to repeat my comment from other blog: why is it necessary to punish someone, instead of encouraging positive behaviour? American scientists revolutionized psychology  early in 20th century, by that very discovery. So, agents who respond to inquiries quickly  should get bonus of some kind (better ratings, more reviews, better placements, discount on their zipcodes etc). We need leads, and it's good for our business to respond quickly, we KNOW that!

 

Dec 14, 2011 07:08 AM
Kathy Knight
Intracoastal Realty Corp - Wilmington, NC
BROKER, ABR, CRS, GRI, SFR, SRES

I cannot believe that Zillow would even attempt to grade agents. I think that before they do that they should make sure their data is 100 % correct in the way they are categorizing real estate before they start grading agents. That is the funniest thing ever because in this business i have received email addresses for Mickey Mouse, Idonthave an account email addresses and a myriad of other wacky addresses that dont make sense. People give wrong numbers as you mentioned Philip and if you cant get them - how will they know.  Crazy

Dec 14, 2011 07:16 AM
Tamara Inzunza
Realty One Group Capital - Alexandria, VA
Close-In Alexandria and Arlington Living

How frustrating.  Yet another reason why I loathe these third party companies who use our data, to generate leads to sell back to us. 

Dec 14, 2011 07:20 AM
Jennifer Fivelsdal
JFIVE Home Realty LLC | 845-758-6842|162 Deer Run Rd Red Hook NY 12571 - Rhinebeck, NY
Mid Hudson Valley real estate connection

Phil sadly this is an issue we probably will be seeing more of.  Angie's List is truly one of the few outfits out there handling rreviews correctly, hopefully others will follow that model.

Dec 14, 2011 08:23 AM
Maria Morton
Platinum Realty - Kansas City, MO
Kansas City Real Estate 816-560-3758

J Phil, Zillow needs to collect and verify all information from what they call 'leads' before setting unrealistic expectations. Most of what they call a 'lead' is trash. Not only is Zillow acting irresponsibly, they may be opening themselves up to law suits. It would be a shame to take up the courts time in ecouragiing Zillow to act as a responsible, professional company but perhaps that is what is needed.

Dec 14, 2011 08:30 AM
Sara Bonert
Zillow - Atlanta, GA
Real Estate Internet Marketing

Hey Phil - Just seeing this, sorry for the delay in responding.  And I know Brad is at a real estate event in San Diego all day (speaking about reviews ironically), so I'm sure he'd find time to weight in more once back. 

First the verbiage - not going to argue there because I'm not a fan either. Email already sent off about that. 

The bigger issue is debate point of letting 'anyone with a computer' write a review - a point that is always heavily debated internally. For what it's worth, this can happen on any review site.  I could review a restaurant I've never eaten at on Yelp or a product I've never used on Amazon.  Or maybe I walked in the restaurant, but never got seated, thus causing a negative review without having eaten.  At least Zillow has a feedback and moderation loop built in. 

Recently I was on a panel with a large real estate service company who just launched their own rating system where they email/direct mail clients following a closing and use that data for their review system.  I feel like that skews positive and isn't a true gauge because if the client made it all the way to the closing table let's hope they liked the job you were doing and have few negative things to say!  Which means the process of how they selected and worked with the agent prior to getting to that point is also valuable. 

A few points:

First, if someone is submitting bogus info in a contact form (as we all know happens) I believe the likelihood that they take the time to do a full review is slim.

Secondly, we would be able to check if someone actually submitted a form to you that matched up with the review.  If we see that there isn't any contact info in the form submitted, that review would be trashed.

Third, Zillow allows for the listing agent to respond to each review.  If an agent chooses not to respond to an inquiry, I'm sure they have a good reason (or maybe it did get caught in the spam filter) and there is a system in place for you to share that if you wish. 

I am always shocked to see the unopened rate on the email contact forms we send.  There are some agents who are stellar, as I know you are, about responding to electronic contacts.  There are others who are not, or simply don't want to bother with cultivating them.  The review system is an effort to help good agents shine and help consumers make their choices accordingly.  Consumers are smart about this sort of thing.  If they see you have 7 glowing reviews and one person says you didn't respond, already no weight is paid to that one review.  However, weighting a closed transaction review differently than minimal contact interaction is definitely something we can think more about internally. 

As always, thanks for the balanced feedback.  And to all who read this - please know that you can always flag any review received on Zillow and it will be reviewed by an actual person in our Seattle office to make sure it is within our terms of use and not fraudulent. 

 

 

 

Dec 14, 2011 09:12 AM
J. Philip Faranda
Howard Hanna Rand Realty - Yorktown Heights, NY
Associate Broker / Office Manager

Sara- 

Yes, I am paying attention

Dec 14, 2011 09:42 AM
Lyn Sims
Schaumburg, IL
Real Estate Broker Retired

JP:  The balls in your court now. Hope you read the post that Leslie also did today that sent Sara over.

I don't think that Sara's response should have included any other site's 'problems'.  Just talk about the company that you work for instead of blathering on about what other sites do. Who cares, the post is about who you work for.

Dec 14, 2011 09:55 AM
Sara Bonert
Zillow - Atlanta, GA
Real Estate Internet Marketing

RE #94 - as someone who is 33 weeks pregnant, the pickles actually look good! :)

Dec 14, 2011 10:09 AM
Sara Bonert
Zillow - Atlanta, GA
Real Estate Internet Marketing

I don't think they are necessarily problems - at least nothing that would stop me from using either site.  Can you imagine the staff they'd have to take on if they'd have to moderate each comment, considering the 1000's of reviews they get everyday?  The tradeoff could be no free shipping on Amazon or a subscription model at Yelp.  As a consumer, I'm smart enough to throw out the one star rating someone gave a restaurant because they didn't get seated fast enough, espicially when there are 20 other reviews about the great food.  Actually it sort of makes the overall review look more real. 

Dec 14, 2011 10:15 AM
J. Philip Faranda
Howard Hanna Rand Realty - Yorktown Heights, NY
Associate Broker / Office Manager

Sara, there are times we can't respond to a review. I recently had a client pull the plug on his own short sale because he got conflicting advice. If the guy flamed me, I would be unable-for fiduciary reasons- to respond with the facts necessary to put that flame into context because of confidentiality rules. I can live with that risk.

I recently blogged about a person I met for the first time at a showing of one of my listings who went Jeckyll and Hyde on me- again, he could hammer me too, because we had substantive contact. I can live with that risk.

We deal with kooks every day. But bad reviews from people I never met? Do we really have to debate this? Seriously? I have to explain this? 

It's a terrible policy, Sara. And this thread on Zillow speaks to the disagreement to it even among consumers: http://www.zillow.com/advice-thread/Zillow-Agent-Reviews-A-Request-For-Sanity/425605/

I know reviews are screened. But this email made it very clear that there would no second chances, and that isn't fair. And why should I need appellate court for this? 

Kristin Acker's thoughts here are disturbing. What does a tekkie know what it is really like dealing with the public out in the field? 

Trulia has a system inside their email that tracks responses so it would not be my word against theirs. Zillow, if they insist on this awful policy, should take some of that IPO money and adopt a similar email interface so they know I responded. Then I would not have to go through any process to debunk the junk. 

Trulia email system

Dec 14, 2011 10:21 AM
J. Philip Faranda
Howard Hanna Rand Realty - Yorktown Heights, NY
Associate Broker / Office Manager

At any rate, I appreciate you giving this the consideration you have, especially with what you have on your plate, and I am glad you got the first pic. 

Dec 14, 2011 10:23 AM
Nate Gerard
Keller Williams Premier - Stillwater, MN
CDPE, East Metro Twin Cities Realtor

It's helpful that Sara responded. I do agree that reviews from clients who have gotten to closing probably skew positive, however not all would. I also say that if you are a good agent you should have mostly positive reviews since most of your clients are getting to closing and you're delivering excellent service.

I also must admit that I didn't know just anyone off the street with an IP address can say whatever they want on Zillow. I'm all for allowing journalistic integrity (I worked in the newspaper business for many years prior to becoming a Realtor) however, this is like the newspaper allowing anyone to email a story and it's guaranteed to make tomorrow's paper. That's not integrity, it's reckless journalism.

I'm not sure how Zillow could confirm a person has worked with an agent because some of the folks we work with don't get to closing. However, a review should be from someone who has met us and worked with us in some way.

I'll be following this one closely.

Dec 14, 2011 03:25 PM
Loreena and Michael Yeo
3:16 team REALTY ~ Locally-owned Prosper TX Real Estate Co. - Prosper, TX
Real Estate Agents

I followed Sara's comment but I didn't find an ultimate decision on what she said. Perhaps, the word is that things are not changing, so just bare with the consequences?

I'm sorry Phil. You know me by now that I'm a perfectionist. A 4.9 review for me is not good enough and having so many reviews and 1 negative could possibly yield that never perfect "5" star score. That bothers me ALOT.

Dec 14, 2011 08:20 PM
Anonymous
Tug

Comment by Kirstan Acker of Zillow made just a short time ago at Zillow

************************

Great debate here.

What we see in usability testing is that buyers and sellers use a combination of factors to decide which agent to contact. It includes their picture, their brokerage, their listings, their years of experience, their description of themselves, and their reviews. We are trying to put all the information we have in front of the consumer and let her decide.

Reviews have an impact, for sure. Agents with positive (4.0 and up) reviews (which the vast majority have) get contacted more often than those without.

@J Phillip: Here's what we found which may surprise you:  Agents with not-quite-perfect review averages get contacted more often by consumers than agents with "perfect" (5.0) scores.

I think that is because consumers know no agent is perfect and they're ok with that. So the 4.8 average looks more believable. They just want to learn as much as they can about a professional they're thinking about working with.

Thanks for all the opinions. We will look at other ways to capture responsiveness, but for the time being, we're sticking with what we have.

Kristin

Dec 15, 2011 04:23 AM
#101
Jim Hale
ACTIONAGENTS.NET - Eugene, OR
Eugene Oregon's Best Home Search Website

The folks from Zillow are completely out to lunch.  Their property valuation system is entirely bogus.  Their page one Google ranking is completely ridiculous.  Their rating system now adds insult to injury.

If there was a rating system for outfits like theirs.....

Dec 15, 2011 03:55 PM
Denise Hamlin, Broker/Owner
Cardinal Realty ~ 319-400-0268 - Iowa City, IA
Helping Happy Clients Make Smart Choices

JP, I came here from Leslie's post and honestly I'm almost rendered speechless at the idea that someone who has never met, spoken or had any direct contact with you gets to leave a comment on Zillow. A consumer email that you allegedly didn't answer followed by a "big brother" email from them "generously" giving you a free pass. Nuts is all I can say. Totally Nuts. 

Dec 16, 2011 08:45 AM
Harley Wilcox
West Group Real Estate - Victor, ID
Harley Wilcox

Well written and to the point.

Dec 17, 2011 05:17 AM
Brad Andersohn
Retired Executive Director of Education at eXp - Boulder Creek, CA
ActiveBrad - 707.646.1876

Hey Phil - though we exchanged numerous emails about this, and resolved it before I could even respond, it's great to see that you're helping to get the word out to others.  Reviews on agents are going to happen with or without the feature on Zillow.  Facebook, Youtube, Twitter, Wordpress, Yelp, Google+ etc. are all locations that consumers and clients can rate and review any company, product, tool, or online/offline service. 

Ever watch United Breaks Guitars?  Who would you email or call when this happens?

While we are at nearly 100,000 agent reviews on Zillow, I will admit that the world is not perfect, and a few have been flagged for review. Since we are one of the few (if any) companies that actually moderate reviews, these matters are always resolved one way or another and with a more positive outcome than posts like this might lead people to think or believe. 

It's great to see that you're using our reviews widget here on your AR sidebar, it WILL produce results that many other agents are experiencing by doing the same.  You know my door is always open and that I will do everything I can to help you and others be more successful using our site, and in their business in general. Happy Holidays my friend.  :-)

Dec 19, 2011 04:06 AM
Anonymous
Anonymous

Delete my reviews even though they are good please

http://www.zillow.com/advice-thread/Delete-my-reviews-even-though-they-are-good-please/426315/

Dec 20, 2011 06:23 AM
#107