[blf@Logging /~]:

May 31, 2008

[HACKERS] Core team statement on replication in PostgreSQL (备查)

Filed under: PostgreSQL, database — blowfisher @ 10:09 pm

built-in replication in PostgreSQL 看来有戏了,留个记号在此备查!

* From: Tom Lane
* To: pgsql-hackers(at)postgreSQL(dot)org
* Subject: Core team statement on replication in PostgreSQL
* Date: Thu, 29 May 2008 10:12:55 -0400
* Message-id: <26529(dot)1212070375(at)sss(dot)pgh(dot)pa(dot)us>

http://archives.postgresql.org/pgsql-hackers/2008-05/msg00913.php

The Postgres core team met at PGCon to discuss a few issues, the largest
of which is the need for simple, built-in replication for PostgreSQL.
Historically the project policy has been to avoid putting replication
into core PostgreSQL, so as to leave room for development of competing
solutions, recognizing that there is no “one size fits all” replication
solution. However, it is becoming clear that this policy is hindering
acceptance of PostgreSQL to too great an extent, compared to the benefit
it offers to the add-on replication projects. Users who might consider
PostgreSQL are choosing other database systems because our existing
replication options are too complex to install and use for simple cases
.
In practice, simple asynchronous single-master-multiple-slave
replication covers a respectable fraction of use cases, so we have
concluded that we should allow such a feature to be included in the core
project. We emphasize that this is not meant to prevent continued
development of add-on replication projects that cover more complex use
cases.

We believe that the most appropriate base technology for this is
probably real-time WAL log shipping, as was demoed by NTT OSS at PGCon.
We hope that such a feature can be completed for 8.4. Ideally this
would be coupled with the ability to execute read-only queries on the
slave servers, but we see technical difficulties that might prevent that
from being completed before 8.5 or even further out. (The big problem
is that long-running slave-side queries might still need tuples that are
vacuumable on the master, and so replication of vacuuming actions would
cause the slave’s queries to deliver wrong answers.
)

Again, this will not replace Slony, pgPool, Continuent, Londiste, or
other systems for many users, as it will be not be highly scalable nor
support long-distance replication nor replicating less than an entire
installation. But it is time to include a simple, reliable basic
replication feature in the core system.

—regards, tom lane

May 26, 2008

[Jignesh K. Shah] Problems with PG on Multi-Cores with Multi-TB Data

Filed under: PostgreSQL, database — blowfisher @ 5:00 pm

Problems with PostgreSQL on Multi-core Systems with Multi-Terabyte Data.

– by Jignesh K. Shah

PDF: http://www.blowfisher.net/pubs/pgcon_problems-JigneshK.Shah.pdf

Current Market Trends in Systems

Quad-core sockets are current market standards
> Also 8-core sockets available now and could become a standard in next couple of year

• Most common rack servers now have two sockets
> 8-core (or more ) systems are the norm with trend going to 12-16 core systems soon

• Most Servers have internal drives > 146 GB
> Denser in capacity, smaller in size but essentially same or lower speed
> More denser in case of SATA-II drives

Current Market Trends in Software

• Software (including Operating Systems) have yet to fully catch up with multi-core systems
> “tar” still single process utility

Horizontal Scaling helps a lot but not a good clean solution for multi-core systems

• Virtualization is the new buzzword for Consolidations
> Hides the fact that the software is not able to fully capitalize the extra cores :-(

• Research being done on new paradigms
> Complexity of parallelized software is huge

Current Market Trends in Data

• 12 years ago, a 20GB data warehouse was considered a big database

• Now everybody talks about 200GB-5TB databases

• Some 2005 Survey numbers:
> Top OLTP DB sizes = 5,973 GB to 23,101 GB
> Top DW DB Sizes = 17,685 GB to 100,386 GB
> Source http://www.wintercorp.com/VLDB/2005_TopTen_Survey/TopTenWinners_2005.asp

• Some 2007 Survey numbers:
> Top DB sizes = 20+ TB to 220 TB ( 6+ PB on tape)
> Source http://www.businessintelligencelowdown.com/2007/02/top_10_largest.html

May 2, 2008

OpenBSD 4.3 released!

Filed under: OpenBSD, UNIX — blowfisher @ 12:58 am

OpenBSD 4.3 was released on May 1, 2008.
What’s New?

About OpenBSD:

The OpenBSD project produces a FREE, multi-platform 4.4BSD-based UNIX-like operating system. Our efforts emphasize portability, standardization, correctness, proactive security and integrated cryptography. OpenBSD supports binary emulation of most programs from SVR4 (Solaris), FreeBSD, Linux, BSD/OS, SunOS and HP-UX.

OpenBSD is freely available from our FTP sites, and also available in an inexpensive 3-CD set.

http://www.openbsd.org

www.blowfisher.net  |  Powered by WP