Monthly Release: 2017-03-01

Camlistore version dc4d1650b3 built with Go 1.8.

In addition to all the changes - see the release notes below - we are pleased to introduce "The Camlistore Network": as of now, any Camlistore instance created through the Camlistore Launcher gets a hostname in the camlistore.net domain, as well as an HTTPS certificate for that name. The hostname is the short form of the GPG key fingerprint of the Camlistore instance. So if your GPG key fingerprint is e.g. DF4A6661, your instance runs at https://df4a6661.camlistore.net.

Another notable addition, albeit experimental as well, is the Scanning Cabinet app, a port of bradfitz/scanningcabinet.

Downloads

Release Stats

20 total committers over 602 commits since cf0c847fbf7e3e48ef463e86674520a4da9aedbb including Aaron Boodman, Aleksandr Mogylchenko, Alok Parlikar, Attila Tajti, Brad Fitzpatrick, Daniel Heath, Eric Drechsel, Filippo Valsorda, Jeremy Schlatter, Jeromy, Joseph Anthony Pasquale Holsten, Kate Pek, Ricardo Kirkner, Stephen Searles, Steve Armstrong, Tamás Gulácsi, Tilman Dilo, Will Norris, kortschak, mpl.

Thank you!

Release Notes

• android:
  • avoid excessive UI updates
  • add Cardboard Camera directory
  • build client with Go 1.7
  • fix/update docker build
• app/publisher:
  • do not show all published nodes at root
  • use autocert too when Camlistore does it
  • rewrite gensearchtypes.sh as gensearchtypes.go
  • serve text types with their right MIMEs
  • file rendering and navigation with jquery
  • infinite scrolling of set members
• app/scanningcabinet:
  • new app: scanningcabinet
• blobserver:
  • fix deadlock in MergedEnumerate
• blobserver/b2:
  • add new Storage based on Backblaze B2
• blobserver/blobpacked:
  • change the meaning of -recovery
  • fix missing error check
  • fix TestReindex at Go master
  • make TestPackLarge work with Go tip
  • reindex meta from packed blobs
  • fix manifest doc example
• blobserver/cloudstorage:
  • use cloud/storage Client
• blobserver/diskpacked:
  • allow removing non-existing blob
  • Change the reindex test data, fix hash
• blobserver/encrypt:
  • delete redundant err check
• blobserver/google/cloudstorage:
  • do not panic on failed Fetch
• blobserver/localdisk:
  • gate tmp file creations
• blobserver/s3:
  • limit concurrent PutObject calls
  • new test for writing files
  • Error when an s3 bucket contains non-blob files
• blobserver/shard:
  • added tests
• camlistored:
  • request a name in camlistore.net
  • use Let's Encrypt
  • allow GCL for non-GCE
  • upload gpg key blob on startup
  • add -syslog flag
  • do not use syslog on windows
• camlistored/ui:
  • specify sort order in search queries
  • rename confusing Pudgy menu to Camli
  • Fix search doc URL in log message
  • fix reload menu item for broken websocket connection
  • renamed "Search roots" to "Favorites"
  • fix symlink in filetree view
  • use authentication token instead of Basic Auth
  • implement swipe for left/right nav on mobile
  • upload with input file button
  • port Directory view to React
  • disable tokenAuth when auth is None
  • Add button to remove selection from current set.
  • Fix js error on all search queries
  • remove deprecated getDOMNode calls
• camget:
  • update client share chain when getting blobs from cache
  • print help with -h or --help
• camput:
  • replace kv with leveldb for stat/havecache
  • use wantCapCtime
  • print share URL
  • update for absence of skipDirs
• camtool:
  • print help with -h or --help
  • add sync flags to dump config and control sync concurrency
  • add basic describe --at flag
  • output server-config.json string
• camtool search:
  • added -continue flag to complement -limit
• camtool sync:
  • local path support on Windows
• client:
  • fail properly when no SearchRoot
  • fix transport tests for fba8b457de814baf90412fafc4fbbca7415189e6
  • set camliType, use correct blobref
• config/dev-server-config.json:
  • fix SourceRoot for publisher
  • used leveldb for the dev server instead of kv
  • fix publisher
• constants/google:
  • remove, use oauth2/google instead
• deploy/gce:
  • no self-signed certs, name in camlistore.net
  • show camli version to be deployed
  • temp fix to bring /launch back up
  • remove old TODO
  • fix error overescaping
  • do not ask for password
• devcam hook:
  • add commit-msg hook
• doc:
  • explain how publisher paths work with permanodes
  • TLS certificate configuration
  • fix typo
  • fix publishing link
  • presentations
  • Document substring matching for attribute search
  • add camliNetIP in server-config
• doc/release.txt:
  • fix monthly doc
  • fix typo
• doc/schema:
  • add missing link to bytes.md
• doc/search-ui.txt:
  • Strip trailing whitespace
• doc/server-config:
  • fix genconfig typo
  • add low-level section
• doc/storage.md:
  • Document how to configure s3 storage
• dockerfile:
  • update
  • add CAMLI_GOPHERJS_GOROOT
  • fix for Go 1.8
• dockertest:
  • check for error messages when pulling
  • use official mysql image
• fastjpeg:
  • remove work-around for os/exec bug
• foursquare:
  • Do venue photos requests userless
  • safely access venueItem.Location
• fs:
  • check mountedness with /proc/mounts
  • take At into account for (root)dirs
  • remove noXattr type
  • osxfuse version check shouldn't depend on map ordering
• gitignore:
  • bin/website
  • remove *.go
• gpgchallenge:
  • expose the clients handler
  • more paranoia against clients
  • require public key of at least 2048 bits
  • to prove IP ownership with a gpg challenge
• HACKING:
  • new contrib commit message
• httputil:
  • fix checkSystemRoots for Go1.6
• importer:
  • Unescape tweet content during import
  • warn about insecure form
  • make RunContext.Context be a read-only accessor
  • add long-polling support. make Twitter updates real-time.
  • make the client secret be input type=password
  • cache accounts list
• importer/foursquare:
  • fix attempts to download empty string URLs
  • import also the photo of the companion
  • increment importer version
  • also import who checked in together
  • use golang.org/x/oauth2
• importer/picasa:
  • simplify, consolidate to single file
  • rm anyErr because never set
  • use golang.org/x/oauth2
• importer/pinboard:
  • fix test
  • kill World after test
• index:
  • read blob before acquiring index mutex
  • clean up BlobSniffer a bit
  • util_test.go not an index impl
  • skip reindexing tests on Travis CI
  • improve Corpus attr lookup with signer filter
  • use mime.TypeByExtension to record MIMEType
  • add ClaimsAttrValue
  • test showing issue #756
  • store exifgps keys without exponent
  • add missing locking for some tests
  • make corpus RLock take a context
  • corpus: more valuesAtSigner doc
  • corpus: add Attrs cache to PermanodeMeta
  • fix deadlock with search.
  • simplify out of order indexing
• integration/camput:
  • check we upload same file only once
• make.go:
  • allow dots in mirrored filenames
  • when running with go tip, use Go 1.7 to build gopherjs
  • optionally build camnetdns
  • use host GOOS and GOARCH when go generating zsearch.go
  • do not cross-compile gopherjs
  • generate search types for app/publisher
  • build and run gopherjs for publisher
  • mirror assembly code too
  • remove --use_gopath
  • just build website with -website
  • build for ARM in its own versioned gopath dir
  • make GOARM default to 7, fix TODO
  • add TODO about cross-compiling on ARMvx to ARMvy
  • typo
  • Add parameters to allow for ARM cross compiling
  • require Go 1.6
  • Switch to Go1.7
  • fix version check for go1.8beta and go1.8rc
  • always populate gopherjsGoroot
  • increase, and enforce, git rev to 10 chars
  • switch to Go 1.8
  • make it work for gopherjs again
• misc/amazon/s3:
  • test against fake-s3 in docker
  • fix test for Client
• misc/docker:
  • monthly.go: add blank lines to release notes source
  • fix missing space typo
  • bucket.List + CAMLI_GOPHERJS_GOROOT fixes
  • monthly.go: more grouping of release notes
  • dock.go: print binaries tarball path
  • dock.go: fix flag doc typo for version
  • restore check that we run in docker
  • gensearchtypes.sh does not exist anymore
  • chmod u+x on gensearchtypes.sh
  • Go1.7
  • update VERSION file when pushing new image
  • add zoneinfo to GCE docker image
  • update zip-source.go
  • replace CopyObject calls
  • build ignore for standalone programs
  • rm third_party in zip-source
  • fix third_party move for docker image
  • go 1.6.1
  • stamp version as well to binaries
  • go: bump to Go1.6
  • go1.8rc2
  • go 1.6.2
  • monthly.go: improve download boxes style
  • monthly.go: generate raw release notes
  • monthly.go: generate commit statistics
  • monthly.go: use release date in files names
  • monthly.go: automatically generate a monthly release
  • release: zip-source.go
  • release: fix google cloud use
• misc/pinentry:
  • runPass: set stdin, check error
• netutil:
  • test loopbackIP
• osutil:
  • remove dependency on pkg/env
  • fix Windows build
  • add arguments to RestartProcess
  • catch error from non-implemented Getrlimit
• publisher:
  • support case when published top node is not a set
  • change http status and message when serving root
  • restore SourceRoot configurability
• schema:
  • limit I/O concurrency in Readdir
• schema/nodeaddr:
  • add GivenName, FamilyName
• search:
  • add test to illustrate issue 881
  • fix panic when claim and permanode have no attributes.
  • add precise alloc counts in TestGetPermanodeLocationAllocs
  • unify location Query with Describe
  • allow blob.Parse allocations in TestGetPermanodeLocationAllocs
  • improve location describe performance
  • generate exif file from scratch for location tests
  • make sure getPermanodeLocation does not allocate
  • make floats more visible with post dot zero
  • fix matching location spanning latitude 180
  • fix float VS int bug in BenchmarkLocationPredicate
  • add EXIF files to BenchmarkLocationPredicate
  • add cached geocode results used in benchmarks
  • benchmark location queries
  • add BenchmarkQueryPermanodeLocation
  • clarify sorting limitation
  • add location info to DescribedBlob
  • rename Describe to StartDescribe
  • fix describe race
  • use the right method for locking the index
  • lock index for corpus creation
  • add query and describe benchmarks
  • optimize file search by wholeRef
  • search by "with" keyword
  • RLock Describe requests
  • RLock index around GetBlobMeta
  • remove broken websocket status optimization.
  • add JSON name for filename on DirConstraint
  • add parentof search expression
• server:
  • add missing defer in sync handler
  • add share handler prefix to discovery
  • on auth needed, let us authenticate
  • instruction for updating on GCE
  • update home page and doc about /setup
  • fix sharing, add tests
  • fall back to serving UI resources from GOPATH as last resort
  • HTML escape each sync validation error, put on their own lines
  • synchandler: add exported constructor and IdleWait method
  • sync: allow running validation multiple times
  • sync: fix recent errors logging
• server/app:
  • refresh cached domain blobs on 403
  • do not mutate r.URL.Path
  • proxy search requests for publisher
  • improve app handling
• camnetdns:
  • get certificate from Let's Encrypt
  • persist records in datastore
  • reply with NXDOMAIN when needed
  • implement more of the DNS protocol
  • make it work
  • set authority flag on dns response
  • log all incoming requests
  • default to port 53 on gce
  • add cloudlaunch config
  • start of camlistore.net DNS server
• serverinit:
  • add b2 and encrypt secrets to redaction list
  • allow sorted for other indexes
  • print stack when recovering in InstallHandlers
  • fix blobpacked_index genconfig for GCS
  • remove trailing commas causing invalid JSON
  • improve handling of redacted data in config handler
  • add /debug/goroutines handler
  • improve genconfig error message
  • fix test after 7b78c50007780643798adf3fee4c84f3a10154c9
• sorted:
  • log and skip on too large a key/value
• sorted/levedb:
  • check error on closing iter
• sorted/mysql:
  • drop tables on reindex
  • fix detection of outdated database schema
  • cap number of queries to 20 at a time
  • remove DB from pool when closing
• sorted/sqlkv:
  • rollback failed transaction
  • don't release gate until iterator is closed
• sorted/sqlkv, sorted/sqlite:
  • replace Serial bool with a *syncutil.Gate
• test/integration:
  • make sure testing not linked in camlistored
  • share large file test
  • fix TestCamputUploadOnce for devcam test
• third_party:
  • remove code.google.com/p/goauth2
• third_party/goleveldb:
  • rm tests that need other deps
• third_party/picago:
  • remove unneeded oauth helpers
• third_party/rsc/qr:
  • rm unused web pkg
• travis ci:
  • build with Go 1.6
  • remove go tip
  • update to go 1.7
  • revert to Go 1.7
• types:
  • remove pkg
• vendor:
  • Move remaining stuff from third_party/*
  • update go4.org/wkfs/gcs
  • rm golang.org/x/crypto/openpgp/clearsign
  • add golang.org/x/crypto/openpgp/clearsign
  • add golang.org/x/time/rate
  • rm code.google.com/p/go.crypto/openpgp
  • add golang.org/x/crypto/acme
  • add google.golang.org/api/internal
  • rename google.golang.org/cloud to cloud.google.com/go
  • update bazil.org/fuse
  • update go4.org/lock
  • update github.com/cznic/fileutil
  • fix more website (protobuf) deps
  • update cloud,grpc,protobuf libraries
  • update google.golang.org/cloud
  • update github.com/russross/blackfriday
  • add golang.org/x/sys/unix
  • update golang.org/x/oauth2
  • update http2
  • update go4.org
  • update go4.org
  • update go4.org/lock
  • go4.org/lock
  • update cloud/storage
  • update http2
  • remove future/mime/multipart
  • remove mousetrap dep in github.com/spf13/cobra
  • goexif: unvendor old import path
  • embed: upgrade less.js to 2.6.1, so CSS loads via http/2
  • Update bazil.org/fuse
  • Drop leveldb-go
  • update cloud.google.com/go/logging to V2 API
  • replace google.golang.org/grpc with github.com/bradfitz/grpc-go
  • update react to 15.4.2
  • update gopherjs to 1.8-1
• webserver:
  • force tls MinVersion to TLS1.2
• website:
  • fix nil based panic
  • run on staging instance
  • log when SMTP down
  • launcher: show when in WIP mode
  • make sure autocert is given a host name
  • use golang.org/x/crypto/acme for Let's Encrypt
  • update google cloud dependencies
  • specify Go 1.7 requirement
  • clean up previous docker git container
  • monthly release: 10aa2b3fbd
  • feature monthly releases
  • mv downloadBox to all.css
  • use Let's Encrypt
  • Update Min Go Version to 1.6
  • fix remaining old links to /docs/
  • strip directory index and file extensions
  • simplify docHandler
  • redirect builder to travis
  • add html ext to docs/releases/*
  • update doc URLs
  • fix wikipedia links on prior-art page
  • restore search-ui.txt with link to new page
  • update misc docs to markdown
  • terminology: fix protocol links
  • keep doc/schema flat
  • convert schema docs to markdown
  • serve non-HTML files as raw bytes
  • use custom markdown options
  • serve godocs for /app/ packages
  • serve /doc/ URLs from top-level doc dir
  • refactor mainHandler to allow diff roots
  • do a full cloning of camlistore.org on startup
  • redirect to https
  • fix ssh for git push to github
  • sync commits to github
  • document importers in server-config
  • always remove old demoblob3179 container
  • print error for demo blobserver
  • fix missing return from prev commit
  • make /apiget in demo authenticated too
  • chrome bug repro demo
  • update homepage's latest release
  • do not send mail when no smtp
  • redirect /doc/dir to /doc/dir/ with trailing slash
  • client-config: hint about paths, multiple aliases and sync
  • Instantiate markdownRenderer per-request
  • Document workflow for editing documentation.
  • Convert code, community, and download pages to md.
  • Remove /doc/contributing.md
  • Comment explaining that contributors.html is a fallback.
  • Add links for the latest presentation
  • rename HACKING to CONTRIBUTING.md
  • convert protocol docs to markdown
  • restore the staging instance changes
  • fix google styleguide URL