June 22, 2005 6:25 PM PDT

Microsoft pushes spam-filtering technology

Related Stories

Should Microsoft own antispam?

November 9, 2004

Microsoft-backed antispam spec gets filtered out

September 23, 2004
If your e-mail does not have a Sender ID, Microsoft wants to junk your message.

Sometime around November, Hotmail and MSN will flag as potential spam those messages that do not have the tag to verify the sender, Craig Spiezle, a director in the technology care and safety group at the software maker said Wednesday. The move is meant to spur adoption of Sender ID, he said.

Sender ID is a specification for verifying the authenticity of e-mail by ensuring the validity of the server from which the e-mail came. While the purpose of curbing junk mail may be laudable, the debate on how to stop the tide of junk mail is still ongoing. According to Microsoft, up to 90 percent of e-mail is spam.

Critics say Sender ID, which includes technology developed by Microsoft, is not an accepted standard and has many shortcomings. Also, there are technologies that compete with Sender ID, such as Yahoo's DomainKeys.

"We think Microsoft is trying to strong-arm the industry into the adoption of an incomplete and not accepted standard," said Dave Rand, chief technologist for Internet content security at security software company Trend Micro.

Microsoft's move increases pressure on e-mail senders to adopt Sender ID. The technology requires Internet service providers, companies and other Internet domain holders to publish so-called SPF (Sender Policy Framework) records to identify their mail servers.

About 1 million domains currently publish SPF records, Microsoft said. That's far from the 71.4 million registered domains worldwide at the end of last year. Still, because some large e-mail senders such as AOL support Sender ID, about 30 percent of e-mail today carries Sender ID information, according to e-mail filtering company MessageLabs.

Criticism for the technology
Sender ID has not been a success because it is not very highly regarded, said Ray Everett-Church, co-founder of the Coalition Against Unsolicited Commercial E-mail and co-author of the book "Fighting Spam for Dummies."

"Microsoft has been trying to shove Sender ID down the throats of the Internet community for several years now, to little effect," he said.

Microsoft's unilateral move may hurt Internet users, he said. "Sender ID isn't widely deployed, meaning that average users are now at risk for having their legitimate e-mail tagged as spam when they send messages to Hotmail users."

Experts say one of the problems with Sender ID is that it doesn't work with e-mail forwarding services. The basic premise of Sender ID is to check if an e-mail that claims to be coming from a certain Internet domain is really being sent from the e-mail servers associated with that domain.

"If you receive mail forwarded through, for example, a university alumni account, the Sender ID check fails," said Matt Sergeant, a senior antispam technologist at MessageLabs.

The Internet Engineering Task Force, a standard-setting body, dissolved a working group on Sender ID in September. Still, Microsoft is plowing ahead with Sender ID, perhaps in a last-ditch effort to make good on a promise by Chairman and Chief Software Architect Bill Gates to can spam by 2006.

"All domain holders and e-mail senders should be publishing SPF records and planning to do that now if they want to improve the legitimacy of their mail, plus protect their domain and consumers. It is the responsible thing to do," Microsoft's Spiezle said.

Turning on the filters at Hotmail and MSN will give e-mail senders a reason to adopt Sender ID, Spiezle said. Without an incentive, many have said that they won't publish SPF records, he said. "We're in a catch-22," he said. "What we're trying to do is to do the right thing by giving everyone advance notice."

However, this Microsoft effort to push adoption of Sender ID is likely to fail, certainly with such a short deadline, said Jonathan Penn, an analyst at Forrester Research. "Hotmail is in no position to dictate that organizations adopt Sender ID," he said.

Adopting Sender ID or any other technology requires time and money, Penn said. "Company budgets are on a yearly cycle, and most of them have no money for such a project this year," he said.

Microsoft argues that publishing SPF records is simple. It usually does not require new hardware or software and the most arduous part is doing an inventory of mail servers and the subsequent maintenance of the record, Spiezle said.

See more CNET content tagged:
Sender ID, spam filtering, MSN Hotmail, domain, MessageLabs Ltd.

Add a Comment (Log in or register) 46 comments (Showing first 20 comments)
There are other problems with this as well.
by katamari June 22, 2005 6:42 PM PDT
As much as I support the idea and concept of Sender ID and SPF, I've found too many caveats with them which even the developers of the technologies cannot explain -- such as the technology not working properly with multi-homed hosts, nor does it play well with machines running an SMTP server bound to an IP alias where procmail is in use.

It's quite sad, really; such oversights are what made SMTP into what it is today...
Reply to this comment
I have much better email system
by June 22, 2005 7:55 PM PDT
I have come up with much better idea to ELIMINATE spam completly,its much cheaper and eaisier to create and implemet then all systems so far,actually it is bit simillar to MS but it actually can stop entire spam industry in its tracks.
My questions is ,not being programmer,where is best place to turn to develop or present idea.

If everyone used my system it will completly prevent spam,spaming would be worthless business and regardless or where you use my system it would work.
Again I wonder what is best place to start with idea,I would prefer bigger company to develop rather then using small one.
Reply to this comment View all 2 replies
Email system outlines
by June 22, 2005 8:02 PM PDT
Here is what you can do with my system.
Use exiting email address,you can actually GIVE your email address to anyone you want,evan call your favorite spammer and asked him to spam you,its actually very CHEAP to create,very easy to use,hackable but so complex to hack into that it would take decades,actually it can handle multiuse emails with one single email address and yes it actually has tracking system that is so simple but yet very effective that it will ELIMINATE spam completly.
If anyone knows place to presnt this email me bostech.fl@netzero.com
Reply to this comment
Starting in november, MSN will stop offering email services
by hadaso June 23, 2005 12:15 AM PDT
Starting in november, MSN will stop offering email services. What they plan to do is exactly that. Their users will not be able to receive all their email anymore. Sender-ID is a proprietary and patented method of MicroSoft, and was not adopted because it is not compatible with the licences of the servers used by most email providers. So M$ plans to cut up the email world into pieces, much like the instant messaging world. MSN/Hotmail users should prepare and get an alternative email account before November. Either that or start using their "Junk mail" folder as an Inbox starting November. And of course the new Inbox would receive all the spam.

Neither SPF nor Sender-ID are technologies that can control spam. They can to a very limited extent help avoiding phishing, by identifying the forgery of addresses like INFO@MICROSOFT.COM. But they would not stop mail "from" addresses in all of INFO@MICR0S0FT.COM INFO@MlCROSOFT.COM INFO@M1CROS0FT.COM or INFO@M1CR0SOFT.COM.
Reply to this comment
What "tag to verify the sender"?
by hadaso June 23, 2005 12:17 AM PDT
Can it be that the writer of this article doesn't know what he is writing about? The phrase "flag as potential spam those messages that do not have the tag to verify the sender" from the first paragraph suggests that. There is no "tag" in messages conforming to either Sender-ID or SPF. The only thing required is a specially formated TXT record published in the DNS for the domain. And then of course that all email sent "from" the domain be sent from a server in the range designated by this record. This is no real problem if recipients would follow the standard, since the standard includes the option to designate "any host" as a possible server. But you can count on MSN not to honor the standard and filter mail if the designated range is "too wide". And of course if it's Sender-ID(TM) then there's also the burden on the senders to follow a quite complex set of rules on formatting email headers, (not all of these rules are 100% compiant with RFC2822 - the email message formatting standard) and to first get permision from M$ to use their patented method.
Reply to this comment
Message has been deleted.
by stenar June 23, 2005 12:40 AM PDT
Reply to this comment
what about...
by Scott W June 23, 2005 12:59 AM PDT
...those of us who use our own computers as SMTP servers? i use sendmail on linux to send my e-mail and i do not believe i would be able to obtain a SenderID as i do not use an e-mail provider. how do M$ intend that i send e-mails to sheep on MSN? i don't want to use an e-mail provider because my previous one, for unknown reasons, is not allowing me to access my outgoing server to send them, thus the reason i use sendmail. it seems that M$ would happily try and cut off 70% of consumers off from its service. they forget that they do not own e-mail like they own the desktop and the internet so they cannot push their weight around.
Reply to this comment View all 2 replies
once more.....
by Earl Benser June 23, 2005 4:26 AM PDT
... MS is late to the party, and forgot to get dressed. If it takes a
hacker more than 10 minutes to defeat this Sender ID crap, the
hacker should be demoted to newbie. The key to controlling SPAM
is to eliminate the few sources which provide most of the SPAM.
There are adequate laws on the book for that now, what we need is
someone with the hiorsepower to apply them, not another useless
MS 'innovation' .
Reply to this comment
SPF vs. Sender ID
by roger.d.miller June 23, 2005 5:45 AM PDT
The quotes from the Microsoft guy specifically refer to SPF. Nowhere is he quoted as mentioning Sender ID. Is it possible that the author of this story doesn't understand the difference between the two?

The fact that a Microsoft guy is again talking about SPF is probably the big news here.
Reply to this comment View reply
Should expect no less...
by Sentinel June 23, 2005 6:00 AM PDT
...from MS. Like always, Microsoft wants to own everything. If they could buy the Internet, they would've done so already. Even after the Internet Engineering Task Force refused Sender ID as the standard, MS is still trying to push it. The IETF should somehow penalize Microsoft for such a move.

What Microsoft is doing is not only harmful to consumers, but is also disrespectful to the Internet standards bodies, like the W3C and the IETF. Their policy seems to be "Our standard was refused, but it will be the standard because we say it is." This is a subversive attitude, not wanting to play by the rules.

Now, I do applaud Microsoft for the Hotmail Spam Filters. They have done miracles for me, to the point where I only recieve about three or four Spam messages a week, and those are delivered to the Junk Mail folder. It makes me wonder why MS seems to think that their Sender ID is necessary, when they already have good filters.

The real solution to spam is in the consumer. Basically anyone can avoid being spammed: all you have to do is not subscribe to any newsletters, avoid entering porn sites and don't click on any "Free Screensaver" or "1,000,000th visitor" ad you see. This does not guarantee you will never recieve spam, but it will be minimal.
Reply to this comment
HotMail market share
by Frodo42 June 23, 2005 6:17 AM PDT
Enforcing Sender ID will probably have quite an impact on HotMail marketshare. Downwards. I noticed that GMail passed HotMail last month, and I'd expect many more to migrate if they find much legitimate email junked. I had that problem myself, and moved to GMail, which has a much better spam filter. User interface & size, too, now we're at it.

I expect that this would backfire monumentally. But probably they'll abandon the idea before it launches when they notice that ISP's are not following their intentions.
Reply to this comment View reply
Let's see if the Antitrust overseeers balk at THIS!
by technewsjunkie June 23, 2005 7:04 AM PDT
I doubt it because I believe the "remedy" was largely a sham.

Again, Microsoft shouldn't be able to dictate and create defacto
"standards" by leveraging its Monopoly in the Windows Distribution
Channel.
Reply to this comment
Sounds like a reason to avoid MSN and Hotmail.
by rcsteiner June 23, 2005 9:39 AM PDT
Not that I've used or recommended those services in the first place.
Reply to this comment View all 2 replies
easy
by June 23, 2005 9:50 AM PDT
If all it takes to comply (would 'obey' be better?) is to a SPF/TXT record to my DNS zone, I'll go ahead and add one.
Reply to this comment View reply
Microsoft can sit and spin!
by June 23, 2005 10:21 AM PDT
If MS think they can cram this down my throat, just because some of my users may get their emails flagged at spam if they send emails to hotmail.com users, then they can think again. I am definately not adopting Sender ID, because of their approach!
Reply to this comment
Just Use Gmail
by 201293546946733175101343322673 June 23, 2005 11:18 AM PDT
Its junk mail filter is one of the best :)
Reply to this comment View reply
Microsoft pushes spam-filtering technology
by mstrhypno June 23, 2005 1:05 PM PDT
Just what we all need, Microsoft pushing an ID strategy that
won't allow forwarding of email! Brilliant! Genius! Incredible!

And completely worthless.

When are the people in Redmond going to get a clue about how
email actually works - that people forward messages all the
time, especially people using academic accounts and those who
use anonymous posting systems for good reasons - like those
who want to STAY anonymous because they have problems with
cyberstalkers and REAL stalkers, whacked-out ex's, nasty
divorce issues and even problematic issues like spammers who
have beaten every anti-spamming technology to come down the
pike to date?

When will they understand that some people actually VALUE their
privacy? When will they understand that Microsoft has NO right
to know WHO they are?

Yet they want everyone to identify themselves or they won't be
allowed to use their Hotmail service. If that's the case, then my
suggestion to the public is to use something else and teach
Redmond a lesson - that they are NOT the only players on the
Web!

Lee Darrow, Chicago, IL
Reply to this comment
Get your own house in order
by June 23, 2005 3:13 PM PDT
two thirds of the spam I receive comes from either Hotmail or Yahoo with the sender indicated by random letter string. Maybe Uncle Bill should spend less time playing Big Brother and more time ferreting out zombies on his network
Reply to this comment
Hurts consumers with their own domain
by June 24, 2005 3:08 AM PDT
I have a big problem with it, although I don't believe it will ever be widely accepted anyway. I have a family domain name for personal use through myfamilyaddress.com. I already have to send email from my ISP's mail server instead of my domain's mail server, because my ISP blocks port 25 (another attempt to curb spam). So they want to block you from sending email via your domain's mail server, then not accept your email unless it comes from your domain's mail server. You can't do both otherwise people would be locked into only using their ISP provided email. Hmmmm, that smells like a monopoly. I suppose we'll all have to use MSN as our ISP in order to use hotmail.

Same goes for thousands of people who work from home and send mail from their corporate addresses using their ISP's SMTP server due to port 25 blocking. They'd all be bocked by Sender ID.

I say who cares about Hotmail, there are plenty of free email providers that provide better service than hotmail anyway. I personally have a rule setup to block all incoming mail from hotmail because so much junk mail is coming from hotmail addresses (albeit usually spoofed addresses).
Reply to this comment View reply
The bottom line.... Avoid MSN and Hotmail like the plague!!!
by qazwiz June 24, 2005 12:27 PM PDT
This is just another reason to avoid the pariahs known as MSN and Hotmail

there has been bad talk about the pair for years and very little good.

the message before me (title Hurts consumers with their own domain name) has implemented a drastic but good idea... he has his filters trash any hotmail sender due to high spam.. spam that wouldn't be stopped by the "ID" in question since hotmail obviously includes it in their eMail

in all my time on the internet I've only encountered two, maybe three, actual people who use hotmail and the two I can think of are both overseas

might I suggest an extension to my predecessors extreme?

go ahead and automatically trash hotmail senders... BUT FIRST evaluate the subject line for a code word (a suggestion COLDMAIL) that will send it to inbox if found.... have friends add the codeword to all eMails and they won't be trashed
Reply to this comment
 See all 46 Comments >>
Powered by Jive Software
advertisement

Latest tech news headlines

RSS Feeds

Add headlines from CNET News to your homepage or feedreader.

More feeds available in our RSS feed index.

advertisement

Inside CNET News

Scroll Left Scroll Right
  • News - Business Tech

    Chrome's JavaScript challenge to Silverlight

    The advent of Google's Chrome browser, software pros say, should spur a big speedup for JavaScript, which would raise its standing against Microsoft's Silverlight technology.

  • Gallery

    Photos: Top 10 reviews of the week

    Here are CNET Reviews' 10 favorite items from the past week, including the TiVo HD XL, Sony Cyber-shot DSC-H50, and the Dish Network's newest digital TV converter box.

  • News - Apple

    Apple watchers spot 'iPod Nano' pix, iTunes hints

    The rumor mill has long been predicting a longer, leaner new version of the iPod Nano, and now it's conjuring up some pictures.

  • Coop's Corner

    Chris Shipley 1, Internet lynch mob 0

    Demo's impresario goes public with a tart and smartly written riposte to the shoot-from-the-lip crowd.

  • Video

    Katie Couric reflects on first Webcast

    The political conventions are over and so are CBS Evening News anchor Katie Couric's first series of Webcasts. CNET's Kara Tsuboi sat down with Couric on the final night of the Republican National Convention to discuss what she liked about Webcasting, some of her most memorable guests, and whether TV news will still be around by the next round of conventions.

  • News - Digital Media

    Google-focused satellite enters orbit

    The search titan has exclusive rights among online mapping sites to images from the new GeoEye-1 satellite, which launched Saturday.

  • Video

    YouTube plays party politics

    During the presidential campaigning four years ago, YouTube didn't even exist. Now it's a tool candidates must master to get their message across. CNET's Kara Tsuboi stops by the YouTube upload booths at the Democratic and Republican conventions to find out why Google's video site has such a big presence in Denver and St. Paul, Minn.

  • News - Gaming and Culture

    Are Demo and TechCrunch50 fragmenting their audiences?

    With both events scheduled to start Monday, many press, as well as venture capitalists and others are having to choose which one to attend.

  • News - Cutting Edge

    Execs predict next Google-like tech

    On eve of company's 10-year anniversary, researchers and business pundits speculate about what technologies might someday have as much impact as Google.

  • Gallery

    Images: The art of 'Spore' prototypes

    Will Wright and his Maxis team worked on dozens of prototypes to test the elements of their soon-to-be-released evolution game. Here's a sampling.

  • Crossfade

    The Standard, 'A Different Skin': Free MP3 of the Day

    Eschewing the danceable beats favored by many of its post-punk brethren, while opting instead for more ominous and insistent rhythms, is what makes the Standard visceral and engaging. Download a free MP3 of "A Different Skin" courtesy of CNET Download Mus

  • Green Tech

    Duke Energy to invest in mini solar power plants

    Can hundreds of rooftop solar panels collectively operate like a central power plant? Duke Energy launches $100 million distributed solar program to find out.