Elasticsearch For Beginners: Indexing your Gmail Inbox (opens in new tab)

(github.com)

221 pointsantoaravinth8y ago20 comments

20 comments

16 comments · 6 top-level

Cyberdog8y ago· 4 in thread

> First, go here and download your Gmail mailbox…

> The downloaded archive is in the mbox format

So really, these instructions are for indexing any mbox-formatted mailbox.

noncoml8y ago

> So really, these instructions are for indexing any mbox-formatted mailbox.

It may not be what you expected, but this is wrong.

The instructions tell you how to download your Gmail emails to mbox format, so they are instructions on how to index your Gmail emails.

kelnos8y ago

In a way, though the instructions specifically handle GMail labels which aren't present in other mbox files. But it's pretty general for any mbox email dump.

styfle8y ago

Also, any new emails you received since exporting your mailbox will not be available.

emodendroket8y ago

I mean, isn't this obvious if you're fetching a file representing your inbox?

1 more reply

gh02t8y ago· 3 in thread

Worth noting that if you like the idea of indexing your mail, there's also Notmuch. It's a dedicated email search and indexing tool and is very nice when paired with something like OfflineIMAP to sync messages.

https://notmuchmail.org

work_account8y ago

Gmail users wanting to try notmuch probably want something like https://github.com/gauteh/gmailieer for seamless tag<->label integration.

cryptonector8y ago

Ohhh, this is exactly what I want, minus emacs.

gh02t8y ago

Not sure if you're saying you want emacs or don't, but...

* You want emacs - https://notmuchmail.org/notmuch-emacs/

* You don't want emacs - https://github.com/pazz/alot (I use this one, it's very nice)

Also Mutt - https://notmuchmail.org/notmuch-mutt/

2 more replies

sailfast8y ago· 1 in thread

This is a great "get to know ES" project use case for elasticsearch! Frees you a bit from having to use Google search while also teaching you how to use queries / aggregations. Awesome work. Will give this a shot later.

Thanks for putting this together.

emodendroket8y ago

Maybe the Thunderbird guys could use it because the search remains the worst part of using Thunderbird after all these years.

buzzdenver8y ago· 1 in thread

What is that http://ohardt.us/download-gmail-mailbox URL where you're supposed to download your email ? Looks fishy, though the hostname doesn't even resolve so not sure what's going on.

antoaravinthOP8y ago

You can download from https://takeout.google.com/settings/takeout

jaydestro8y ago· 1 in thread

this is like using a jackhammer to nail in a pin isn't it? what's the benefit other than a faster search?

GrinningFool8y ago

It's a teaching tool. The benefit is to show someone how to use ES for a real-word thing.

With that said, I suspect given tuning based on your search patterns and usage - you could get more accurate search results when you control the indices, stop words, etc.

est8y ago

> Prerequisites: Set up Elasticsearch

More like first get yourself a host with at least 16gigs of RAM first.

j / k navigate · click thread line to collapse

20 comments

16 comments · 6 top-level

Cyberdog8y ago· 4 in thread

> First, go here and download your Gmail mailbox…

> The downloaded archive is in the mbox format

So really, these instructions are for indexing any mbox-formatted mailbox.

noncoml8y ago

> So really, these instructions are for indexing any mbox-formatted mailbox.

It may not be what you expected, but this is wrong.

The instructions tell you how to download your Gmail emails to mbox format, so they are instructions on how to index your Gmail emails.

kelnos8y ago

In a way, though the instructions specifically handle GMail labels which aren't present in other mbox files. But it's pretty general for any mbox email dump.

styfle8y ago

Also, any new emails you received since exporting your mailbox will not be available.

emodendroket8y ago

I mean, isn't this obvious if you're fetching a file representing your inbox?

1 more reply

gh02t8y ago· 3 in thread

https://notmuchmail.org

work_account8y ago

Gmail users wanting to try notmuch probably want something like https://github.com/gauteh/gmailieer for seamless tag<->label integration.

cryptonector8y ago

Ohhh, this is exactly what I want, minus emacs.

gh02t8y ago

Not sure if you're saying you want emacs or don't, but...

* You want emacs - https://notmuchmail.org/notmuch-emacs/

* You don't want emacs - https://github.com/pazz/alot (I use this one, it's very nice)

Also Mutt - https://notmuchmail.org/notmuch-mutt/

2 more replies

sailfast8y ago· 1 in thread

Thanks for putting this together.

emodendroket8y ago

Maybe the Thunderbird guys could use it because the search remains the worst part of using Thunderbird after all these years.

buzzdenver8y ago· 1 in thread

What is that http://ohardt.us/download-gmail-mailbox URL where you're supposed to download your email ? Looks fishy, though the hostname doesn't even resolve so not sure what's going on.

antoaravinthOP8y ago

You can download from https://takeout.google.com/settings/takeout

jaydestro8y ago· 1 in thread

this is like using a jackhammer to nail in a pin isn't it? what's the benefit other than a faster search?

GrinningFool8y ago

It's a teaching tool. The benefit is to show someone how to use ES for a real-word thing.

With that said, I suspect given tuning based on your search patterns and usage - you could get more accurate search results when you control the indices, stop words, etc.

est8y ago

> Prerequisites: Set up Elasticsearch

More like first get yourself a host with at least 16gigs of RAM first.

j / k navigate · click thread line to collapse